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Data Structure and Methods for Providing an interactive Program 

Guide 

CROSS REEERENQE TO RELATED APPLICATIONS 
5 This application claims benefit of U.S. Provisional paten application 

serial number 60/093,891 filed July 23, 1998, which is hereby incorporated 
by reference in its entirety. 

This application is related to contemporaneously filed U.S. Patent 

Application Number (attorney docket number 

10 DIVA 071), which is incorporated herein by reference in its entirety. 

The invention relates to communications systems in general and, 
more specifically, the invention relates to an interactive electronic program 
guide suitable for use in an interactive video information delivery system. 

15 

tt AHTCftROTTND OF THE DISCLOSURE 
In several communications systems the data to be transmitted is 
compressed so that the available bandwidth is used more efficiently. For 
example, the Moving Pictures Experts Group (MPEG) has promulgated 

20 several standards relating to digital data delivery systems. The first, 
known as MPEG-1, refers to the ISO/DEC standards 11172 and is 
incorporated herein by reference. The second, known as MPEG-2, refers to 
the ISO/IEC standards 13818 and is incorporated* herein by reference. A 
compressed digital video system "is described in the Advanced Television 

25 Systems Committee (ATSC) digital television standard document A/53, and 
is incorporated herein by reference. 

The above-referenced standards describe data processing and 
manipulation techniques that are well suited to the compression and 
delivery of video, audio and other information using fixed or variable length 

30 digital communications systems. In particular, the above-referenced 
standards, and other "MPEG-like" standards and techniques, compress, 
illustratively, video information using intra-frame coding techniques (such 
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as run-length coding, Huffman coding and the like) and inter-frame coding 
techniques (such as forward and backward predictive coding, motion 
compensation and the like). Specifically, in the case of video processing 
systems, MPEG and MPEG-like video processing systems are characterized 
5 ' by prediction-based compression encoding of video frames with or without 
intra- and/or inter-frame motion compensation encoding. 

Over the past few years, television has seen a transformation in the 
variety of means by which its programming is distributed to consumers. 
Cable television systems are doubling or even tripling system bandwidth by 
10 migrating to hybrid fiber coaxial (HFC) cable as an information delivery 
medium. Many consumers have turned to direct broadcast satellite (DBS) 
systems to receive higher quality (with respect to NTSC) video imagery. 
Other video information delivery approaches using high bandwidth digital 
technologies, intelligent two way set top boxes and other methods are used 
15 by information providers to offer services that are differentiated from 
standard cable and over the air broadcast systems. 

With this increase in bandwidth, the number of programming choices 
has also increased. Leveraging off the availability of more intelligent set 
top boxes, several companies such as Starsight® and Prevue™ Guide have 
20 developed elaborate systems for providing an interactive listing of the vast 
array of channel offerings, expanded textual information about individual 
programs, the ability to look forward to plan television viewing as much as 
several weeks in advance, and the option of automatically programming a 
VCR to record a future broadcast of a television program. 
25 An interactive digital video on demand (VOD) service known as the 

DIVA system is manufactured by DIVA Systems Corporation of Menlo Park, 
California. The DIVA system distributes audio-visual information to 
individual subscribers utilizing MPEG-like information streams. DIVA 
subscribers utilize intelligent set top terminals (STT). 
30 Unfortunately, the existing program guides have several drawbacks. 

They tend to require a lot of memory, some of them needing upwards of one 
megabyte of set top terminal memory. They are typically very slow to 
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acquixe their current database when they are turned on for the first time or 
are subsequently restarted (e.g.. a large database maybe downloaded to a 
set top terminal using only a vertical blanking interval (VBI) data insertion 
technique). Disadvantageous^, such slow database acquisition may result 

5 in out of date database information or, in the case of a pay per view (PPV) or 
video on demand (VOD) system, limited scheduling flexibility for the 
information provider. Additionally, the user interface to existing program 
guides does not usually look like a typical television control interface; rather 
the user interface looks like a 1980s style computer display (i.e.. blocky, ill- 

10 formed text and/or graphics). 

Therefore, it is seen to be desirable to provide a method and 
apparatus for providing the functionality of electronic program guide in a 
manner tending to reduce the above-described problems. 

15 RTTMMARY OF TITT? INVENTION 

The invention provides an interactive electronic program guide that 
isolates an interaction model at the set-top box level, where no context is 
associated with any user interaction, and where merely the manipulation of 
audio and visual elements representing, applying, removing and shifting 
20 emphasis from one area or another. All items containing contextual 
information reside in a centralized location where they will be processed 
and the management of network resources executed in a manner to enable 
• the request context-based service request or transition. 

The invention works by combining the use of broadcast digital video 
25 streams with video-on-demand streams to produce a compelling audiovisual 
user interface. The invention uses an intelligent set top boxes ability to 
manipulate a graphics overlay plane displayed in conjunction with a video 
image on an intelligent analog or digital set top box. The system allows the 
interactions to carry the user from broadcast (or narrowcast) video stream to 
30 broadcast (or narrowcast) video stream, from broadcast (or narrowcast) 
video stream to pointcast video stream, and from pointcast video stream to 
broadcast (or narrowcast) video stream. 
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Guide and image regions of the IEPG displays are provided within 
video streams broadcast, narrowcast or pointcast video streams provided by 
the head end. That is, the program guide information is assembled at the 
head end and provided as video information to the STTs within the system. 

5 Manipulation of video layer objects is accomplished by proxy manipulations 
of graphic layer objects. The STT provides (beyond tuning, demultiplexing, 
decoding and such operations) the ability to highlight or emphasize object 
and select a highlighted or emphasized object. The graphic information 
manipulated by the STT is received via a data stream (Le., a data PID), 

10 auxiliary data, private data and the like. Advantageously, since there is no 
local storage of an entire program guide data base, memory resources of the 
STT are conserved. Rather, information sufficient to e.g., describe a 
highlighted program title is included within the aforementioned data 
stream, which may be contemporaneously transmitted to the STT along 

15 with the video stream including the channel group/time slots including the 
program title. 

A program guide according to one embodiment of the invention 
comprises: a video layer comprising a plurality of video objects including 
title objects, each title object having associated with it a channel and at 

20 least one time slot, the video layer being formed in response to a received 
video stream; and a graphics layer comprising a plurality of graphics objects 
including title overlay objects, each of the title overlay objects selectively 
imparting at least a visual de-emphasis to a respective title object in the 
video layer, the visual de-emphasis being imparted to title objects not being 

25 associated with a desired time slot. 

In another embodiments of the invention, the opacity level of the title 
overlay object is increased to impart the visual de-emphasis to a respective 
title object. Optionally, the title objects subjected to de-emphasis are 
substantially hidden. 

30 In another embodiments of the invention a color of the title overlay 

object is adapted to impart the visual de-emphasis to a respective title 
object. 
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ttPTTT.P racRHRTPTION ™? THE DRAWINGS 
The teachings of the present invention can be readily understood by 
considering the following detailed description in conjunction with the 
5 accompanying drawings, in which: 

FIG. 1 depicts a display screen of an interactive electronic-program 

guide (IEPG); 

FIG. 2 depicts subscriber side equipment suitable for use in an 
interactive information distribution system; 
10 FIG. 3 depicts a flow diagram of a user interaction method suitable 

for use in the subscriber side equipment of FIG. 2; 

FIG. 4 depicts a high level block diagram of an interactive 
information distribution system; 

FIG. 5 depicts a flow diagram of a user intetaction method suitable 
15 for use in the subscriber side equipment of FIG. 2; 

»f an interactive electronic program 
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FIG. 16 depicts a flow diagram of a head end stream request 
processing method. 

To facilitate understanding, identical reference numerals have been 
used, where possible, to designate identical elements that are common 
5 within the figure. 

DESCRIPTION OF THE EMBODIMENT 
The invention will be described within the context of an interactive 
information distribution system, illustratively the DIVA interactive digital 
10 video on demand (VOD) system. However, it will be readily apparent to 
those skilled in the art that the teachings of the present invention may be 
advantageously utilized in other interactive video information distribution 
systems. 

FIG. 1 depicts a display screen 100 of an interactive electronic 

15 program guide (IEPG) according to the invention. Specifically, the 
exemplary interactive program guide screen 100 comprises a time of 
* day/date (DOT) indicator 105, a promotional "splash" object 110, a cable 
system or provider logo 115, a video barker 120 (and associated audio 
barker), a program time indicator 125, a channel number indicator 130, a 

20 channel identifier (text or logo) 135, a pair of channel display decrement 
objects 140a and 140b, a pair of channel display increment objects 145a and 
145b, a temporal increment object 148, a temporal decrement object 147, a 
program grid 150 and a scrolling promotional banner 155. The interactive 
program guide display 100 is displayed on a television screen or other video 

25 presentation device in, e.g., the home of a subscriber to a cable television or 
other information distribution system utilizing the interactive electronic 
program guide. Subscriber side equipment suitable for receiving and 
displaying is described in detail in FIG. 2. 

Referring to FIG- 1, the interactive program guide display 100 is 

30 comprised of a video layer and a graphics layer. That is, the IEPG display 
100 is primarily formed at a central or head end location in, for example., a 
cable television system. Video information representative of each of the 
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objects or elements previously described (105-155) is generated at the cable 
central processing location or a head end, and transmitted as part of a video 
stream. Thus, the actual display parameters (i.e., the size, shape, color, 
position and other visual parameters) associated with each object are 
5 entirely controlled at a central location. 

Those on screen objects which may be modified by the subscriber are 
selected by, e.g., a remote control device cooperating with the set top 
terminal, which causes the locally stored and7or locally generated graphical 
overlay objects to be manipulated in a manner identifying the objects on the 
10 screen produced at the head end. That is, each manipulable object or 

element is associated with a corresponding graphical overlay element (e.g., 
an x-y coordinate box or other element). The overlay element has selectively 
emphasized or de-emphasized (e.g., selectively shading, highlighting 
coloring and the like) via manipulation of the remdte control unit. 
15 Upon receiving a "select" entry from the remote control unit, the set 

top terminal transmits, via a back channel,, the information that identifies 
the selected object to the head end. It is important to note that changing 
the emphasis of an object or element is performed entirely at the local level. 
That is, there is no change in the actual video information transmitted by 
20 the head end to the subscriber. Only the graphical overlay layer on the 

display is changed. 

The user interaction manipulations are those manipulations that are 

intended by the user to change a particular emphasis or overlay 

highlighting or overlay position on the screen. By contrast, other 
25 manipulations may be intended to change video information displayed on 

the screen such as the position (temporal or channel) of the program grid, 

selection of a promotional object and the like. 

The interactive program guide display 100 (Le., the video layer 

provided by the head end) depicts a program offering of 10 channels within 
30 a 1.5 hour time interval. Since there are 24 hours in a day, 16 video streams 

are required to depict 24 hours of program offerings of 10 channels. These 

16 video streams may be included within a single transport stream. Thus, a 
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user desiring to view the next 1 V4 hour time interval (e.g., 9:30 - 11:00) 
may activate a "scroll right" object (or move the joystick to the right when a 
program within program grid 150 occupies the final displayed time 
interval). Such activation will result in the controller of the STT noting that 
5 a new time interval is desired. The video stream corresponding to the new 
time interval will then be decoded and displayed. If the corresponding video 
stream is within the same transport stream (i.e., a new PID), then the 
stream will be immediately decoded and presented. If the corresponding 
video stream is within a different transport stream, then the different 
10 transport stream will be extracted from the broadcast stream and the 
appropriate video stream will be decoded and presented. If the different 
broadcast stream is within a different broadcast stream, then the different 
broadcast stream will be tuned, the different transport stream will be 
extracted from the different broadcast stream and the appropriate video 
15 stream will be decoded and presented. 

Similarly, a user interaction resulting in a prior time interval or a 
different set of channels (i.e., a.group of channels) will result in the retrieval 
and presentation of an appropriate video stream. It is important to note 
that each extracted video stream is associated with a common audio stream. 
20 Thus, the video/audio barker function of the program guide is continuously 
provided, regardless of the selected video stream. 

The above described user manipulations, and the resulting change in 
presented video streams, are all within the same ''context" of the program 
guide. That is, the context of the program guide (i.e., the contextual model) 
25 described thus far is the "program guide" context in which user 

manipulations to the guide are used to modify the attributes of the program 
grid. In the event of a user selection of a highlighted or emphasized 
program within the program grid, the context changes to a "program 
selected" context, in which the video and audio information streams 
30 associated with a selected channel are retrieved and presented to the user. 
The selection information is coupled to the head end a the back channel. 
The head end then couples the appropriate streams to the user, if they are 
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not already being received by the user. In the program selection context, 
the user may have selected a broadcast stream (i.e., a network feed), a 
narrowcast stream (a regional or local information feed, such as a 
community or public access channel) or a pointcast stream (such as a pay 
5 per view event or interactive shopping channel). 

After the user has finished viewing or otherwise utilizing a selected 
program, the operating context of the STT/program guide will return to the 
program guide context. That is, any pointcast or narrowcast "session" that 
was initiated due to the selection of a program will be torn down upon 
10 completion of that program. The user will be returned to the broadcast 
streams associated with the program guide of the present invention. The 
concept of contextual shifting and the implications for bandwidth utilization 
described in more detail below. Briefly, the invention operates to maximally 
utilize the bandwidth within an interactive information distribution system 
15 by allocating system functionality to system components (Le., server side 
and subscriber side) such that a common interactive program guide may be 
provided by the head end to multiple subscribers via a broadcast (i.e., non- 
specific subscriber delivery) technique, which requires less expensive 
transmission techniques than those used for pointcast (i.e.. subscriber 
20 specific delivery) transmission techniques. 

FIG. 2 depicts a subscriber side equipment suitable for use in the 
present invention. Specifically, FIG. 2 depicts a set top terminal (STT) 
comprising a tuner 210, a demodulator 220, a transport demultiplexer 230. 
an audio decoder 240, a video decoder 250, an on screen display processor 
25 (OSD) 260, a frame store memory 262, a compositor 290 and a controller 
270. User interaction is effected via a remote control unit 280. Tuner 210 
receivers, e.g., a radio frequency (RF) signal comprising a plurality of 
quadrature amplitude modulated (QAM) information signals from a forward 
channel such as a hybrid fiber optic cable television system. Tuner 210. in 
30 response to a control signal TUNE, tunes to a particular one of the QAM 
information signals to produce an intermediate frequency (IF) information 
signal. Demodulator 220 receives and demodulates the intermediate 
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frequency QAM information signal to produce an information stream, 
illustratively an MPEG transport stream. The MPEG transport stream is 
coupled to a transport stream demultiplexer 230. 

Transport stream demultiplexer 230, in response to. a control signal 
5 TD produced by controller 270, demultiplexes (i.e., extracts) an audio 
information stream A and a video information stream V. The audio 
information stream A is coupled to audio decoder 240, which decodes the 
audio information stream and presents the decoded audio information 
stream to an audio processor (not shown) for subsequent presentation. The 
10 video stream V is coupled to the video decoder 250, which decodes the 
compressed video stream V to produce an uncompressed video stream VD 
that is coupled to the compositor 290. OSD 260, in response to a control 
signal OSD produced by controller 270, produces a graphical overlay signal 
VOSD that is coupled to the compositor 290. 
15 Optionally (e.g., in the absence of a default or predetermined overlay 

design), transport stream demultiplexer 230 retrieves a data stream DATA, 
illustratively an auxiliary data.stream or user data stream according to, 
e.g., the MPEG standards, The retrieved stream DATA provides 
information regarding overlay parameters and other program guide 
20 information. The data streammay also include the other profile parameters 
inserted into the forward channel bitstreams by a profile unit 460 of FIG. 4 
(described below). 

Additionally, , in one embodiment the data stream identifies, 
sequence header location, GOP structure, coding parameters, PID locations, 
25 program map tables and other information suitable for use by controller 270 
in, e.g., selecting appropriate decoding or processing parameters. 

• The compositor 290 merges the graphical overlay signal VOSD and 
the uncompressed video stream VD to produce a modified video stream (Le., 
the underlying video images with the graphical overlay) that is coupled to 
30 the frame store unit 262. The frame store unit 262 stores the modified video 
stream on a frame-by-picture basis according to the frame rate of the video 
stream. Frame store unit 262 provides the stored video frames to a video 
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processor (not shown) for subsequent processing and presentation on a 
display device. The frame store unit 262, in response to a control signal F 
produced by the controller 270, "freezes" in memory (i.e., does not update) a 
presently stored video frame such that the video information provided to the 
5 video process results in a still image. This is useful when, e.g., a broadcast 
program guide utilizes scrolling information, a telephone number or address 
is briefly displayed or a user simply wants to view a presently displayed 
frame for a longer period of time. 

Controller 270 comprises a microprocessor 272, an input/output 
10 module 274, a memory module 276, an infrared (IR) receiver 275 and 

support circuitry 278. The microprocessor 272 cooperates with conventional 
support circuitry 278 such as power supplies, clock circuits, cache memory 
and the like as well as circuits that assist in executing the software 
routines. The input/output circuitry .274 forms an interface between the 
15 controller 270 and the tuner 210, the transport demultiplexer 230, the 

onscreen display unit 260, the back channel modulator 295, and the remote 
control unit 280. Although the. controller 270 is depicted as a general 
purpose computer that is programmed to perform specific interactive 
program electronic guide control function in accordance with the present 
20 invention, the invention can be implemented in hardware as an application 
specific integrated circuit (ASIC). As such, the process steps described 
herein are intended to be broadly interpreted as being equivalently 
performed by software, hardware, or a combination thereof. 

In the exemplary embodiment of FIG. 2, the remote control unit 280 
25 comprises an 8-position joy stick, a numeric pad, a "select" key, a "freeze" 
key and a "return" key. User manipulations of the joy stick or keys of the 
remote control device are transmitted to a controller via an infra red (IR) 
link. The controller 270 is responsive to such user manipulations at several 
levels of abstraction. Specifically, the controller interprets user 
30 manipulations as interaction model manipulations or interface model 
manipulations, which are described below. 
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Interaction model manipulations are those manipulations which 
depend only upon local processing resources, such as changing overlay 
object emphasis or selecting a new video stream within a previously tuned 
and demodulated transport stream (ie., a sub-stream having only a 
5 different packet id (PID) than the presently displayed sub-stream or tuning 
to another channel already present in the broadcast spectrum). Interface 
model manipulations are those manipulations which require interaction 
with the head end, such as selection of an object that requires a change from 
a broadcast mode of operation to a pointcast mode of operation. These 
10 modes will be described in more detail below. Briefly, in a broadcast mode 
of operation, many subscribers receive and utilize the same information 
stream. In a pointcast mode of operation, only one subscriber receives and 
utilizes a particular information stream. 

Referring to FIG. 1, emphasis and selection of promotional splash 110 
15 changes the context from the program guide context to a shopping guide 
context. Within the shopping guide context the user is allocated an 
individual interactive information stream (i.e., a pointcast stream) allowing 
the user to buy a particular product, browse a particular group of products 
or otherwise interact with the server. Similarly, selection of the logo object 
20 115 or any of the channel objects 135 or channel number objects 130 results 
in a narrowcast information stream that provides the user with general 
information associated with the companies or individuals identified with the 
logos or channel boxes. Within a narrowcast context just described, a user 
may change to a pointcast context to retrieve more particularized 
25 information. Similarly, if the user emphasizes and selects the video barker 
object 120 a new stream is provided to the user in which the video barker 
may be displayed at full screen resolution or a promotional screen other 
than the video barker may be displayed. Optionally, ordering information 
for a pay preview event represented by the video barker may also be 
30 provided. Scrolling promotional banner 155 may also be selected, bringing 
the user to a narrowcast or broadcast stream that provides a promotional 
video barker or other information. It should be noted that the time of day 
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information and date information 105 may be retrieved by the subscriber 
and utilized to synchronize the clock within the subscriber terminal. 

The interactive program guide 100 depicted in FIG. 1 is formed using 
a single video stream having an associated audio stream and a 

5 corresponding graphic overlay. The program guide display 100 depicts an 
hour and a half time interval for each often channels. Thus, to depict an 
entire 24-hour time interval for ten channels, it is necessary to provide 16 
separate images or display screens of information. 
Each particular video screen may be associated with a packet ID (PID) 

10 value. A plurality of such video streams may be included within a single 

transport stream. 

FIG. 3 depicts a flow diagram of a user interaction routine 300 
suitable for use in the subscriber side of equipment of FIG. 2, and more 
particularly, suitable for use in the controller 270 of the subscriber side 
15 equipment depicted in FIG. 2. The routine 300 is entered at step 302, when 
the subscriber side equipment is powered on. The routine 300 then 
proceeds to step 304, where a first or default broadcast stream from the 
forward channel is tuned by RF tuner 210 in response to a control signal 
TUNE provided by controller 270. The tuned broadcast stream. 
20 illustratively BS1. is demodulated by demodulator 220 to produce one or 
more transport streams which are coupled to transport stream 
demultiplexer 230. A video stream having a default packet ID (PID) and an 
audio stream having a default packet ID (PID) are demultiplexed by 
transport stream demultiplexer 230 to produce an encoded audio stream AE 
25 and an encoded video stream VE. 

After tuning the first broadcast stream and demultiplexing the first 
video stream and associated audio stream (step 304), the routine 300 
proceeds to step 306, where an appropriate overlay is retrieved from 
memory unit 276. That is, a default overlay, e.g., an overlay stored in static 
30 overlay storage unit 276-1 in a memory unit 276, may be retrieved by the 
stroller 270 and coupled to the OSD generator 260. Optionally, as 
previously discussed, transport demultiplexer 230 also demultiplexes a 
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control and applet data stream, illustratively an auxiliary data stream 
included with the signal received via a forward channel. This data stream 
may include specific overlay information intended to be used with the 
received program stream and stored in the dynamic overlay storage unit 
5 276-2. Alternatively, the received data stream may include simply X-Y grid 
coordinates that may be used to calculate an appropriate overlay for the 
video stream. The overlay information may simply be default information 
suitable for use in a fixed (i.e„ predetermined) on screen program guide 
display. Upon retrieving the appropriate overlay, the routine 300 proceeds 

10 to step 308. 

At step 308 routine 300 presents the merged overlay and video 
information stream. That is, the decoded video stream VD produced by 
video decoder 250 and the on-screen display stream VOSD produced by OSD 
unit 260 are merged together by compositor 290 tb produce a merged video 

15 stream which is then coupled to a video processor (not shown) for further 
processor prior to presentation on a display device. Contemporaneously, 
audio decoder 240 is decoding the appropriate audio channel, i.e., the audio 
information stream associated with the audio PID of step 304, which is then 
coupled to an audio processor for subsequent presentation by a set of 

20 speakers. The routine 300 then proceeds to step 310, where it waits for a 
user command. Upon receipt of a user command, i.e., upon receipt of a joy 
stick manipulation indicative of an on-screen program guide co m m a nd such 
as a change in object emphasis or a selection of an object or other related 
commands, the routine proceeds to step 312, where the received user 

25 command is evaluated. 

After evaluation the received user command (step 312) the routine 
300 proceeds to step 314, where a query is made as to whether the received 
command requires processing at an interactivity model level only. That is, 
whether the received command is simply directed towards changing the on 

30 screen object presently emphasized (interactivity model only or set top 

terminal processing only), or directed towards retrieving information found 
in a different video stream. For example, a non interactivity model 
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command includes commands that change the contents of the program grid 
150 (i.e., different group of channels or different displayed time intervals), 
commands that indicate a selection of an emphasized object (i.e., selection of 
a promotional banner or object, selection of a channel, increment or 

5 decrement of the presently displayed group of channels such that a different 
video stream is required, increment or decrement of the displayed temporal 
intervals such that a different video stream is required, and so on. 

If the query in step 314 is answered affirmatively, then the routine . 
goes to step 316, where the overlay is modified. That is, the presently 

10 emphasized object is de-emphasized by the on-screen display unit 260 and 
emphasis is placed on a different object. For example, referring to the 
electronic program guide display 100 of FIG. 1, if the promotional object 110 
is presently highlighted, and the user moves the joy stick in a manner 
indicating an intent to select the logo object 115 (ile., an upper right 

15 movement of the joy stick), then the overlay is modified by de-emphasizing 
object 110 and emphasizing object 115. The routine 300 then proceeds to 
step 308, where the audio and merged overlay and video information are 
presented. 

If the query at step 314 is answered negatively, then the routine then 
20 proceeds to step 318, where a query is made as to whether a time-dependent 
stream is being selected. That is, if the query at step 314 is answered 
negatively, then the received command is such that an additional video 
information stream is to be selected. At step 318 a query is made as to 
whether that additional video information stream to be selected is one of a 
25 time-dependent stream or a time- independent stream. A time-dependent 
stream is a stream that is either broadcast or narrowcast to a plurality of 
subscribers. That is, a time-dependent stream is a stream received by many 
subscribers such that no one subscriber may control the transmission of that 
stream. A time-dependent stream comprises , e.g., a pointcast stream such 
30 as an interactive shopping channel, a pay preview channel and the like. 

If the query at step 318 is answered negatively, the routine 300 
proceeds to step 320, where point cast stream acquisition is initiated. That 
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is, at step 320, the process of initiating a point cast session is started by 
transmitting appropriate information to the server side via the back 
channel. The routine 300 then proceeds to step 322, where the appropriate 
pointcast stream is tuned. The routine 300 then proceeds to step 328, where 

5 the video and audio stream (i.e., the PID associated with video and the PID 
associated with audio) streams are demultiplexed by transport 
demultiplexer 230. The routine 300 then proceeds to step 330, where an 
appropriate overlay is retrieved, and to step 308, for the audio and video 
merged with overlay streams are presented. In the case of a pay preview 

10 presentation, the overlay may comprise a transparent overlay, such that 
there is no on-screen display associated with a pay preview presentation. 
Optionally, the overlay may comprise a small icon or logo to indicate which 
pay preview channel or which cable channel has been selected for 
processing. 

15 If the query at step 318 is answered affirmatively, then the routine 

proceeds to step 324, where any existing narrowcast/pointcast session is 
turn down, and to step 326, where the last broadcast stream tuned by the 
subscriber side equipment is re-tuned and the associated transport stream 
or streams are re-acquired. In this manner, in the event of a user selecting 

20 a particular pay preview or other context changing program, the changed 
context will be returned to the initial program guide context upon exiting 
the context changing (Le., time independent stream). The routine 300 then 
proceeds to step 328, where the video and associated audio streams are 
multiplexed according to the appropriate PID values. The routine 300 then 

25 proceeds to step 330, where the appropriate overlay is retrieved (i.e., the 
program guide object oriented emphasis overlay), and to step 308, where the 
audio and merged overlay and video streams are presented. 

The above described user interaction routine provides an efficient 
method for user navigation within an interactive information distribution 

30 system. Specifically, the user manipulates on screen objects by selectively 
emphasizing or de-emphasizing those objects using a remote control device 
associated with the set top terminal. Within the program guide context 
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objects are emphasized and de-emphasized and selected to retrieve desired 
video and/or audio streams. For example, in the case of the on screen 
display 100 of FIG.l, a user may manipulate any of the objects and select a 
particular object to change the context of the program guide such that the 
5 user changes the level of abstraction by which information is presented. 
FIG. 4 depicts a high level block diagram of an interactive 
information distribution system. Specifically, FIG. 4 depicts an interactive 
video information distribution system directed towards providing a plurality 
of video information streams and an associated audio information stream 
10 suitable for use in the interactive electronic program guide described above 
with respect to FIG. 1. 

The head end processing portion 400 depicted in FIG. 4 comprises an 
audio source 410A, a plurality of video sources 410V1 through 410VN, an 
audio encoder 420A, a plurality of video encoders 420V1 through 420VN, a 
15 plurality of transport multiplexers 430-1 through 430-N. a plurality of 
intermediate frequency (IF) modulators 440-1 through 440-N, a radio 
frequency (RF) modulator 450,.a video profile module 460, a file server 470, 
a clocking source 405, an RF demodulator 480. Audio source 410A provide 
an audio information stream, illustratively an audio information stream 
20 associated with the audio visual barker 120 of the interactive program guide 
display 100 of FIG. 1. The audio information stream is coupled to an audio 
encoder 420A, where it is encoded into a standard compressedaudio format, 
such as Dolby AC3 or another appropriate format. The encoded audio 
stream A is coupled to each of the transport multiplexer units 430-1 through 
25 430-N. 

The first video source 410V1 provides, illustratively, 16 video 
information streams to video encoder 420V1. Each of the 16 video streams 
is suitable for providing the video information necessary to support the 
interactive program guide display 100 of FIG. 1. Specifically, it is noted 
30 that in the exemplary program guide 100 of FIG. 1 up to ten channels may 
be displayed at one time. Thus, each of the video information streams 
includes information sufficient to display a program guide screen 
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comprising a 10 channel group of channels. In one embodiment of the 
invention, each of the 16 video streams coupled to the video encoder 420 
comprises information sufficient to provide all video layer information for a 
single channel group, e.g., channels 1-10. In the case of only one of the 16 
5 video streams being used, the output of the video encoder 420 comprises a 
single encoded video stream (which will be subsequently included in a single 
transport stream). In the case of more that one of the 16 video streams 
being used, the output of the video encoder 420 comprises more than one (up 
to 16) encoded video stream (all of which will be subsequently included in a 
10 single transport stream). It will be noted that 16 video streams represents 
24 hours of programming for a single channel group. 

All the generated streams are temporally aligned in terms of data 
(i.e., streams depicting different channels or different times are aligned such 
that stream to stream switching at a decoder may he accomplished in a 
15 substantially seamless manner. In addition, the streams are generated in a 
synchronized manner with respect to clock source 405, such that GOP 
structures, sequence headers, L-picture location and other parameters 
(which are indicated via the profile unit 460) are (if desired) aligned across a 
plurality of information streams. In this manner, stream splicing may be 
20 performed without noticeable video artifacts or audio artifacts, and without 

excessive latency! 

A database 402 provides program guide information to a plurality of 
video sources 410V1 through 410VN. Each of the plurality of video sources 
410V1 through 410VN is associated with, illustratively, ten channels (Le., 

25 AMC, Fox, HBO and the like). Each of the ten channels provides different 
programming material at different times of the day as denoted by 
programming grid 150 in the interactive electronic program guide display 
100 of FIG. 1. Specifically, since the displayed portion of the programming 
grid 150 comprises a 1.5 hour time interval, it is necessary to associate 16 

30 (25 divided by 1.5) video streams with each ten channel block for each 24 
hour period. That is, a first of the 16 video streams associated with the ten 
channel block is used to identify programming material from 12:00 a.m. 
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through 1:30 a.m., a second stream is used to identify programming 
material from 1:30 a.m. through 3:00 a.m. and so on. Thus, video source 1 
(410V1) provides 16 video information stream to video encoder 1 (420V1). 
wherein each of the 16 video information streams includes program 
5 identification information for channels 1-10 for each of the 16 1.5 hour time 
intervals. That is, each of the 16 video streams is capable of providing the 
video layer used in electronic program guide display 100 of FIG. 1 for a 
respective 1.5 hour time period. 

Included within the program guide display 100 is, of course, the video 
10 barker 120. Associated with the video barker 120 is the audio stream A 

produced by audio source 410A and encoded by audio encoder 420A The 16 
video streams produced by video encoder 420V1, the audio stream produced 
by audio encoder 420A and a reference clock CL produced by a clock source 
405 are coupled to a first transport multiplexer 430-1. Similarly, 16 video 
15 information streams representing 24 hours of programming data for 

channels 11 though 20 are produced by a second video source 410V2, and 
coupled to a second video encoder 420V2. The 16 encoded video streams V2 
produced by second video encoder 420V2 are coupled to a second transport 
multiplexer 430-2 along with the audio stream A and clock stream CL. 
20 Similarly, the Nth video source 410VA produces 16 video information 

streams associated with a 24 hour programming period for the N-9 through 
Nth channels in the system. The 16 video information streams produced by 
the Nth video stream 410VN are coupled to an Nth video encoder 420VN 
where they are encoded. The Nth group of 16 encoded video information 
25 streams VN is then coupled to an Nth transport multiplexer 430-N. along 
with the audio stream A produced by audio encoder 420A and the clock 
signal CL produced by clock source 405. 

Each of the transport multiplexers 430-1 through 430-N produces a 
respective output transport stream Tl through TN that is coupled to a 
30 respective intermediate frequency (IF) modulator 440-1 through 440-N. 
Optionally, the transport streams Tl through TN are coupled to file server 
470 for storage prior to subsequent delivery to the respective IF modulators 
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440-1 through 440-N. The IF modulators 440-1 through 440-N produce 
respective IF output signals which are then coupled to RF modulator 450. 
The RF modulator 450 modulates the respective IF signals onto a carrier 
frequency for subsequent transmission via a forward channel. 
5 It is important to note that, while the transport multiplexing function 

is depicted as being performed by a plurality of transport multiplexers 430-1 
through 430-N, the transport multiplexing function may also be performed 
using a single transport multiplexer. Additionally, while the IF modulation 
function is depicted as being performed by a plurality of IF modulators 440- 
10 1 through 440-N, the IF modulation function may also be performed using a 
single IF modulator. The main constraint placed upon the IF modulation 
function relates to the available bandwidth within the forward channel FC. 
That is, since each IF modulated signal IF1 through IF-N is capable of 
carrying data at a maximum bitrate (e.g., 27Mbps in a 64 QAM modulation 
15 scheme), the total data rate of the transport stream(s) within the IF 

modulated signal cannot exceed the available bandwidth. Thus, in the case 
very high data rate streams are transport encoded, it may be necessary to 
use several IF modulators to produce a corresponding several IF modulated 
signals for transmission via the forward channel FC. 
20 A control and applet source 410D provides control information and 

applet data information (Le., subscriber side programs provided by the 
server) to a packetizer 420D, illustratively an MPEG2 packetizer producing 
an auxiliary data stream then DATA. The auxiliary data stream DATA is 
coupled to RF modulator 450 and, optionally, each of the transport 
25 multiplexers 430-1 through 430-N. In the case of the auxiliary data stream 
DATA being coupled to each of the transport multiplexers, the resulting 
multiplexed transport streams Tl through TN will each include the control 
and applet data such that retrieval of any one of the multiplexed transport 
streams from the forward channel by a set top terminal will yield control 
30 data and applet data sufficient to run any appropriate subscriber side, 
programs. 
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The RF modulated data is coupled to a forward channel within e.g., a 
cable television system or other information distribution system. The 
information distribution system is denoted as data pipe DP and is coupled to 
a plurality of neighborhood information distribution systems 490-1 through 
5 490-3. Each of the neighborhood distribution systems 490-1 through 490-3 
is coupled to a plurality of set top terminals 200. It should 'be noted that 
while each of the set top terminals is denoted by the same reference 
designator (i.e., 200), that each of these terminals will be associated with a 
unique terminal identification (TID) and other subscriber specific 
10 information. The set top terminal 200 described above with respect to FIG. 
2 may be used within the system of FIG. 4. Furthermore, each set top 
terminal is associated with a display device (i.e., a television or other 
display device) and an audio presentation unit (i.e., speakers and associated 
speaker drivers). The display device and speakers' are denoted by the DISP. 

15 L and R designators. 

FIG. 5 depicts a user interaction routine 500 according to the 
invention. The routine 500 is entered at step 502. when subscriber side 
equipment is initially powered on or otherwise initialized. The routine 500 
then proceeds to step 504. where a first or default stream is tuned and 
20 demodulated. The routine 500 then proceeds to step 506. where a first four 
default video stream and associated audio stream is demultiplexed and 
displayed or presented. The routine 500 then proceeds to step 508. where 
an appropriate overlay is retrieved and displayed' along with the displayed 
or presented video stream. The routine 500 then proceeds to step 510, 
25 where the processor waits for user input via, e.g.. remote control device 280. 
Upon receipt of user input, the routine proceeds to step 512, where 
the user input is evaluated. The routine 500 then proceeds to step 514, 
where a query is made as to whether the evaluation indicates that the 
abstraction level indicated by the user input is contextual or local 

30 interactivity. 

If the query at step 514 indicates that the user interaction is such 
that the contextual level of the interactive experience is to be changed, then 
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the routine proceeds to step 516. At step 516 a query is made as to which 
key has been pressed by the user. If the query at step 516 indicates that the 
return key has been pressed, then the routine 500 proceeds to step 518, 
where the previous context is re-acquired. That is, in the case of a present 
5 pointcast context such as a interactive shopping or pay per view context, 
activation of a return key on a remote control device that a return to the 
previous context is required, which would typically mean that return to the 
program guide context is desired. The routine 500 then proceeds to step 
510, where the processor waits for user input. 

10 If the query at step 516 indicates that the key pressed was the select 

key, then the routine proceeds to step 520, where the context is changed in 
response to the emphasized object selected by the select key. The routine 
500 then proceeds to step 522, where the selected context function or 
functions are performed. The routine then proceeds to step 510, where the 

15 processor waits for user input. 

If the query at step 514 indicates that local interactivity only is 
requested by the user, then the routine proceeds to step 524, where a query 
is made as to the type of key pressed by the user. If the query at step 524 
indicates that a freeze key has been pressed by the user, then the routine 

20 proceeds to step 534, where the video frame presently stored in frame store 
unit 262 is frozen. That is, the frame store unit 262 is not updated by 
subsequent video frames until such time as a freeze key or other key is 
pressed again. The routine 500 then proceeds to step 510, where the 
processor waits for user input. If the query at step 524 indicates that an 

25 increment key has been pressed (e.g., a temporal increment or channel 
increment) then the routine proceeds to step 532. At step 532 a query is 
made as to whether the next video stream has indicated by the PID of the 
stream is in fact the last video stream within a particular broadcast stream. 
If the query at step 532 is answered affirmatively, then the routine 500 

30 proceeds to step 538, where the next broadcast stream is timed. The 

routine 500 then proceeds to step 506, where the first video and associated 
audio streams are demultiplexed and displayed or presented. 
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If the query at step 532 is answered negatively, then the routine 500 
then proceeds to step 536, where the next video stream (i.e., the next video 
PID) is demultiplexed and displayed. The routine 500 then proceeds to step 
510, where the processor waits for user input. 

5 If the query at step 524 indicates that a decrement key was pressed 

(i.e., a temporal or channel identification decrement), then the routine 500 
proceeds to step 526, where a query is made as to whether the presently 
selected video stream as indicated hy the PID of the stream is. in fact, the 
last video stream in the presently tuned broadcast stream. If the query at 

10 step 526 is answered affirmatively, then the routine 500 proceeds to step 
528, where the previous broadcast stream associated with the decrement 
key, i.e., the previous broadcast stream including the temporal and/or 
channel information) is tuned. The routine 500 then proceeds to step 506. 
If the query at step 520 is answered negatively, then the previous video 

15 stream associated with the appropriate parameter (Le., temporal or channel 
parameter) is demultiplexed and displayed along with the associated 
overlay. The routine 500 then proceeds to step 510, where the processor 

waits for user input. 

A critical aspect of the present invention is the isolation of the 

20 interaction model at the set-top box level, where no context is associated 
with any user interaction, and where merely the manipulation of audio and 
visual elements representing applying removing and shifting emphasis from 
one area or another. All items containing contextual information will reside 
in a centralized location where they will be processed and the management 

25 of network resources executed in manner to enable the request context- 
based service request or transition. 

This invention works by combining the use of broadcast digital video 
streams with video-on-demand streams to produce a compelling user 
interface in both visual and audio terms. The invention uses an intelligent 

30 set top boxes ability to manipulate a graphics overlay plane displayed in 
conjunction with a video image on an intelligent analog or digital set top 
box. The system allows the interactions to carry the user from broadcast (or 
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narrowcast) video stream to broadcast (or narrowcast) video stream, from 
broadcast (or narrowcast) video stream to pointcast video stream, and from 
PointCast video stream to broadcast (or narrowcast) video stream. 

At the heart of the interactive program guide is a method that takes 
5 the time-dependent information and provides that in streaming mode over a 
series of synchronized real-time video streams. The user of the guide agilely 
moves between these broadcast streams to receive the full set of available 
listings. When the user's interest takes him/her from the domain of time- 
dependent information such as a listing of currently available programming 

10 to the realm of time-independent information such as previews, promos, or 
the like, the streams processed at the set top box transition from broadcast 
to pointcast (on-demand) streams. 

When the user's interest takes him/her from one area of time- 
independent information back to an area of time-dependent information, the 

15 streams requested by the system and processed at the set top box will shift 
from one pointcast stream to a broadcast stream. For example, when a user 
returns to the program guide from an interactive shopping channel or pay 
per view event the video stream served to the user changes from a pointcast 
stream to a broadcast stream. 

20 The user of the exemplary interactive program guide controls the 

logical operation of shifting the emphasis from one "object" to the next 
through the use of an interactive device such as a remote control with 
directional arrows, a joystick or other interactive controller. Such an 
approach may be used with or without an on-screen pointer or cursor. When 

25 the user makes a selection to a single option the tuner in the set top box 
may be force-tuned to the corresponding selection. 

Traversal of the available options in a long list of programming 
options is achieved by providing the option to page through the various sets 
of options. This effect is achieved by jumping from one video stream (by 

30 changing from one PID to another within the same or different QAM 

channel). The advantage of jumping within the same QAM channel is that 
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there will not be any noticeable added latency associated with tuning to the 
new analog channel. 

It is important to note that synchronization of program channel 
numbers with areas of on-screen emphasis is achieved through either in- 

5 band data delivery, out-of-band data delivery, vertical blanking interval 
(VBI) data delivery or other approaches known to those familiar in the art of 
data delivery in broadband networks. That is, data indicative of the 
location of manipulable screen objects (i.e., those objects that may be 
selectively emphasized) is provided to the set top terminal via one or more 

10 techniques. 

Channel options in the Interactive Program Guide can represent any 
combination of programming offered from a wide range of sources, including 
but not limited to, over-the-air broadcast, cable broadcast, satellite 
broadcast, local programming, ad insertion apparatus and can include the 
15 full range of pay channels, pay per view, video on demand, near video on 
demand, internet service, interactive gaming, interactive shopping, free 
programming, etc. Channel numbers can be virtual in nature, and they can 
be remapped in either the set top box or the head end equipment to 
correspond to the service being delivered. 
20 Delivery of PPV, NVOD, VOD, interactive gaming, interactive 

shopping, internet, video classified ads, and other services can be 
integrated into this system in a two-way cable environment through the use 
of cable modem technologies or other back-channel methods known to those 
familiar in the art of enabling such services in a network environment. 
25 This invention may further be used to enable pay television services 

such as subscription services like HBO®, Showtime®, etc., in a two-way 
cable environment through the use of cable modem technologies or other 
back-channel methods known to those familiar in the art of enabling such 
services in a network environment. 
30 This system can further be extended to implement conditional access 

by arranging bitmap information in different data blocks according to types 
of access allowed. Processing of this information would be done at the head 
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end where a series of descriptors are developed for each on-screen area 
capable of receiving emphasis. Part of the descriptors contain entitlement 
"locks" mapping access entitlement to on-screen areas capable of displaying 
emphasis. At the set top box, a series of "keys" exist that map to those 
5 channels the user is entitled to view. If one of the keys "fits" any of the 
locks, the bitmap set linked to the key may receive on-screen emphasis at 
the set top box. 

The invention is unique because, advantageously, it does not require 
the maintenance of television programming lists in the set top box, it adds a 

10 level of interactivity to current broadcast programming guides, it provides a 
more television-like user experience, and it makes the best economic use of 
bandwidth in intricate, asset-rich interactive program guides. 

In one embodiment of the invention, multiplexed broadcast analog or 
digital video and static, pre-programmed bitmaps are utilized. In this 

15 embodiment, the pre-programmed bitmaps are installed in the set top box 
in, e.g., memory module 276. The bitmaps are x-y grid borders that align 
with x-y grid borders built into the broadcast video streams, and are 
modified in color and/or degree of transparency to allow visual emphasis to 
be associated with a single option or set of options. 

20 In another embodiment of the invention, multiplexed broadcast 

analog or digital video and dynamic, pre-programmed bitmaps are utilized. 
In this embo dim ent, a variety of pre-programmed bitmaps are installed in 
the set top box. These bitmaps may be x-y grid borders, circles, or any other 
delineator capable of providing adequate emphasis so that a user may 

25 discern the option of set of options representing an actionable field. These 
may align with borders built into the broadcast video streams and are 
modified in color and/or degree of transparency to allow visual emphasis to 
be associated with a single option or set of options. The set top box can 
move back and forth between one set of bitmaps and another. 

30 Synchronization of a particular set of installed bitmaps to a broadcast video 
stream is achieved through signaling linked to the broadcast video stream 
either through in-band data delivery, out-of-band data delivery, vertical 
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blanking interval data delivery or other approaches known to those familiar 
in. the art of data delivery in broadband networks. 

In another embodiment of the invention, multiplexed broadcast 
analog or digital video and dynamic, updateable bitmaps are used. In this 
5 embodiment, a variety of pre-programmed bitmaps may or may not be 
installed in the set top box. As in the previous embodiment, these bitmaps 
may be x-y grid borders, circles, or any other delineator capable of providing 
adequate emphasis so that a user may discern the option of set or options 
representing an actionable field. These may align with borders built into 
10 the broadcast video streams and aie modified in color and/or degree of 
transparency to allow visual emphasis to be associated with a single option 
or set of options. The set top box can move back and forth between one set 
of bitmaps and another. Synchronization of a particular set of installed 
bitmaps to a broadcast video stream and download of new bitmaps is 
15 achieved through signaling linked to the broadcast video stream either 
through in-band data delivery, out-of-band data delivery, vertical blanking 
interval data delivery or other approaches known to those familiar in the 
art of data delivery in broadband networks. 

In one embodiment of the invention a set top box focus method is 
20 described for transitioning from stream to stream without interruption in 
signal or contextual continuity with parallel information streams in an 
interactive information on demand environment. Specifically, referring to 
FIG. 4 a high level black diagram depicting formation and distribution of a 
plurality of related information streams is shown. Specifically, the related 
25 information streams comprise a single audio information stream and a 
plurality of video information streams. Each video information stream 
comprises image information such as the image information depicted in the 
interactive electronic program guide display 100 of FIG. 1. However, each 
video stream is associated with different channels as identified in the 
30 channel grid 150, channel identification 135 and channel number 130 
objects in the display 100 of FIG. 1. 
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In one embodiment of the invention, text information is integrated 
into video streams to provide a video-based, remote cast interactive program 
guide. That is, text information is included within the downstream video 
portion as part of the onscreen program guide. This text information may 
5 comprise, e.g., stock quotes and other information. 

In another embodiment of the invention, profiling data is produced by 
transport demultiplexer 230. Specifically, transport demultiplexer 230 
produces data indicative of GOP structure, sequence header locations, I- 
picture locations, PID identifications, and other information included in the 
10 broadcast streams and/or video and audio streams included within that 
broadcast stream. 

In another embodiment of the invention, a system and method for 
advertisement insertion into point cast and narrowcast digital distribution 
systems is disclosed. Specifically, advertisements' appropriate to a 
15 particular subscriber or a group of subscribers in, e.g., a neighborhood, are 
inserted into point cast or narrowcast digital video streams going to that 
subscriber or neighborhood of subscribers. 

In another embodiment of the invention, a system and method for 
invoking an information stream using a video-based, remote-cast interactive 
20 program guide in an interactive information-on-demand system is disclosed. 
That is, in this embodiment of the invention. 

In another embodiment of the invention, a method and apparatus for 
processing conditional access information for a video-based, remote cast 
interactive program guide is disclosed. Also disclosed is a method and 
25 apparatus for merging multiple sources of scheduled and on-demand 

programming for a video-based, remote cast interactive programming guide. 
Additionally disclosed is a system and method for inserting advertisements 
into an interactive program guide based on user profiles (i.e., demographic 
profiles). These demographic profiles are also useful in targeting, in either 
30 point cast or narrowcast streams, advertising material for a particular 
subscriber or a group of subscribers. Also disclosed is a method and 
apparatus for blending sub-elements of independent MPEG streams to 
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make a single unified MPEG stream (also known as slice level splicing). In 
this embodiment, particular elements of the onscreen program display are 
associated with particular slices. That is, a slice comprises one or more 
contiguous blocks within a single row of macroblocks. The first block of a 

5 line is always the first block of a slice, the last block of a line is always the 
last block of a slice. A line may comprise a single slice or multiple slices. 
By forming the onscreen display according to a slice-based regional 
approach, slice level splicing may be performed at a subscriber end by, e.g., 
controller 270 adaptively coupling slices from one or more information 

10 streams to an output. 

Also disclosed is a method and apparatus for the generation of rewind 
tracks for MPEG in near real time. That is, the head end processing system 
may include, in addition to standard (i.e., forward) video information 
streams, additional information streams comprising a temporally reversed 

15 information stream. This temporally reversed information stream need not 
be transmitted contemporaneous to the forward information stream. 
Rather, portions of the rewind information stream may be transmitted such 
that a slicing operation between the streams may result in a stream 
switching without excessive latency, while at the same time the rewind 

20 track is acquired rapidly and provided to the output. 

FIG. 6 depicts a display screen of ah interactive electronic program 
guide (IEPG). Specifically, FIG. 6 depicts an exemplary interactive program 
guide display 600 that is formed and operates in a manner similar to that 
described above with respect to the IEPG display 100 of FIG. 1. That is, the 

25 interactive program guide display 600 of FIG. 6 utilizes a video layer and a 
graphics layer that is displayed on, e.g., a television screen or other video 
presentation device in, e.g., the home of a subscriber to a cable television or 
other information distribution system. Video information representative of 
each of the IEPG objects or elements is generated at the cable television 

30 central processing end or the head end and transmitted as part of a video 
stream. Graphic layer objects are associated with at least those video layer 
objects that may be manipulated by user interaction via, e.g., a remote 
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control device. Subscriber side equipment suitable for receiving and 
displaying the IEPG is described above with respect to FIG. 2. 

The primary differences between the IEPG displays of FIG. 1 and 
FIG. 6 are as follows: First, the IEPG display 100 of FIG. 1 utilizes a 
5 program grid 150 to present programming information, whereas the IEPG 
display 600 of FIG. 6 utilizes an enhanced "hide and reveal" technique to 
present more information to a viewer while reducing the amount the 
amount of display clutter experienced by the viewer in navigating through 
the available programming choices. Second, the IEPG display 600 of FIG. 6 
10 includes a program description object that is used to display, illustratively, 
a brief textual description of a program occupying a presently indicated time 
slot of a presently indicated channel. 

The IEPG display 600 of FIG. 6 comprises a first 605A, second 605B 
and third 605C time slot object, a plurality of channel content objects 610-1 
15 through 610-8, a pair of channel indicator objects 641A, 641B, a video 
barker 620 (and associated audio barker), a cable system or provider logo 
615, a program description object 650, a day of week identification object 
631, a time of day object 639, a next time slot object 634, a temporal 
increment/decrement object 632, a prompt line object 642, a "favorites" filter 
20 or selection object 635, a "movies" filter or video on demand (VOD) selection 
object 636, a "kids" (Le., juvenile) programming filter or VOD selection 
object 637 and a "sports" programming filter or VOD selection object 638. it 
should be noted that the day object 63 1 and next time slot object 634 may 
comprise independent objects (as depicted in FIG. 6) or may be considered 
25 together as parts of a combined object. Each of the channel content objects 
610-1 through 610-8 comprises a channel number object NUM, a channel 
identification object ID, a first title object 611A, a second title object 611B 
and a third title object 611C. The channel number object NUM indicates 
the actual or virtual channel number of the channel identified by the 
30 channel identification object ID. The first 611A, second 611B and third 
611C title objects depict the titles of programs provided by the channel 
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during time slots indicated by, respectively, the first 605A, second 605B and 
third 605C time slot objects. 

The IEPG display 600 of FIG. 6 is logically divided into two 
operational zones or regions, a guide region and an image region. The guide 

5 region comprises the time slot objects 605, channel content objects 610-1 
through 610-8 and channel indicator objects 641A, 641B. The image region 
comprises the remaining objects. When a user or viewer is interacting with 
the program guide of the present invention, only one of these two regions 
will be active. Some keys or controls utilized by a viewer to control the 

10 IEPG will operate differently, depending upon which region is active. The 
operational differences between the two regions will be described in more 
detail below. 

Referring now to the guide region of FIG. 6, it can be seen that the 
second time slot 605B is highlighted or emphasized by a time slot 

15 highlighting object 605H. Similarly, it can be seen that each respective 
second title object 611B of each of the plurality of channel content objects 
610-1 through 610-8 is also emphasized or highlighted by a title 
highlighting object 611H. Time slot emphasis is coordinated with title slot 
emphasis. That is, if the first time slot object 605A is emphasized or 

20 highlighted, then the first title object 611A of each of the plurality of 
channel content objects 610-1 through 610-8 is also emphasized or 
highlighted. Similarly, if the second time slot object 605B is emphasized or 
highlighted, then the second title object 611B of each of the plurality of 
channel content objects 610-1 through 610-8 is also emphasized or 

25 highlighted. This coordinated highlighting or emphasizing of time slot 605 
and title 611 objects assists the viewer in determining which titles within 
the respective channel content objects 610-1 through 610-8 are associated 

with which time slot. 

In one embodiment of the invention, the coordinated emphasis or 
30 highlighting of time slot and tide objects is accomplished by using the 
graphics layer to de-emphasize the de-emphasized or non-highlighted time 
slot and tide objects. That is, the opacity of the graphics layer proximate 
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the de-emphasized or non-highlighted time slot and title objects is adjusted 
to a level of opacity that is lower than the level of opacity of the emphasized 
or highlighted time slot and title objects. In the case of only two levels of 
opacity, the non-highlighted or de-emphasized objects are hidden using a 
5 full opacity level, while the highlighted or emphasized objects are revealed 
using a zero opacity level (i.e., transparent graphics layer). In the case of 
more than two levels of opacity, the difference in opacity levels between 
emphasized and de-emphasized objects may selected to provide clear 
indication to the viewer of object highlighting or emphasis, while retaining 
10 the viewer's ability to read the non-highlighted or de-emphasized objects. 

In one embodiment of the invention, the coordinated emphasis or 
highlighting of time slot and title objects is accomplished by using the 
graphics layer to adjust a color, brightness or other of an object, or display 
area surrounding the object. For example, an x-y coordinate grid or other 
15 shape surrounding an object to be highlighted or emphasized may be 

changed in color or brightness level such that the surrounded or proximate 
object is emphasized. Similarly, an x-y coordinate grid or other shape 
surrounding an object to be non-highlighted or de-emphasized may be 
changed in color or brightness level such that the surrounded or proximate 
20 object is de-emphasized. 

The program description object 650 of the image region is used to 
display a description of a presently indicated title. The description 
comprises, illustratively, one or more of a brief textual description of the 
title, title start and end times, title run time, title ratings (e.g., MPAA or 
25 other ratings), title reviews (e.g., "thumbs-up" or "thumbs-down" or other 
qualitative indicia), ranking of title in comparison to other titles (e.g., 
popularity, aggregated positive or negative viewer feedback) and the like. 

The pair of channel indicator objects 641A, 641B (or a single channel 
indicator objects 641A or 641B) is used to indicate which of the plurality of 
30 channel content objects 610-1 through 610-8 includes a highlighted or 

emphasized title object 611 having associated with it title description within 
the program description object 650. That is, the channel indicator objects 
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641A, 641B provide a visual indication of a presently indicated channel t the 
viewer. 

It is important to note that the video barker 620 of FIG. 6 (and the 
video barker 120 of FIG. 1) is, itself, an object that may be selected in some 
5 embodiments of the invention. Specifically, in such an embodiment where 
of the video barker 620 is used to present a movie trailer, selection of the 
video barker object 620 by the user implies a desire to view that movie in. 
e.g., a video-on-demand context. Thus, in an embodiment of the invention 
where the video barker comprises an active or selectable object, selection of 
10 the video barker brings the user to a video-on-demand interaction screen 
where the user is provided the opportunity to purchase the movie presented 
in the video barker. Similarly, where the video barker is used to present 
merchandise or other products and/or services for sale, selection of the video 
barker results in the user being brought to an interaction screen suitable for 
15 fulfilling a user's desire to purchase or shop for such goods and/or services 
(e.g., an advertisement from a store is associated with a virtual mall, an 
advertisement for a restaurant is associated with a food coupon retrieval 
system, either virtual or via regular mail after entering a name and 
address). 

20 Referring now to FIG. 6 the second channel 610-2, which is indicated 

by the channel indicator 641A and 641B, includes a second title 6UB that is 
associated with the highlighted or emphasized second time slot 605B. In 
one embodiment of the invention, selecting this title (i.e., pressing the 
"select" key when the guide regions is active per the IEPG display 600 of 
25 FIG. 6), which is to be presented in the future, results in the user being 

transferred to a preview screen depicting a preview of the selected title. For 
example, in the case of the selected title being a television sitcom to be 
broadcast in, e.g., 20 minutes from the present time, selecting that title 
results in the user being taken to a preview information screen related to 
30 the sitcom. Similarly, in the case of the selected title being a boxing match 
or other sporting event usually associated with a pre-game show or pre-fight 
program of some sort. This pre-game show or pre-game program may be on 
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one or more channels. Thus, in the case of a sporting event being associated 
with one or more pre-game or pre-event programs, the user is brought to a 
screen in which he may select which of these pre-event programs he would 
like to view. Alternatively, the user is brought to a screen describing 
5 something to do with the upcoming fight 

When the guide region is active, user manipulations of left or right 
arrow keys on, e.g., a remote control device, result in a change in the 
highlighted or emphasized time slot; while user manipulations of up or 
down arrow keys result in a change in the indicated channel. In the case of 
10 a change in time slot or channel indication, contents of the title description 
information that is displayed as the program description object 650 is also 
changed. The guide region becomes inactive and the image region becomes 
active when the user utilizes the left or right arrow keys to highlight or 
emphasize an object within the image region (i.e., icons 631-639). The 
15 response of the system to user manipulations will be described in more 
detail below with respect to FIGS. 8-9. 

Referring now to FIG. 6.- the guide region of the interactive program 
guide display 600 (i.e., the video layer provided by the head end) presents to 
a viewer a tabular representation of available programming on a predefined 
20 number of channels (e.g., eight channels) and for a predefined period of time 
(e.g., 1 V4 hours) utilizing a "hide and reveal" technique. That is, each of the 
eight channels displayed (e.g.. channels 17-24) is associated with a title for 
each of the three time slots of interest By highlighting a particular time 
slot (via left/right arrow key activation), the appropriate titles within the 
25 displayed channels are in turn emphasized. 

There are several important considerations that must be understood 
with respect to the use of interactive electronic program guides by a user. 
First, it is important to the user that the time and title information is 
clearly presented in a way that is understandable and without undue 
30 eyestrain due to, e.g.. screen clutter. The subject invention reduced screen 
clutter by the use of selective emphasis including changes in opacity to de- 
emphasize title information and/or time information. Moreover, the subject 
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invention provides a dear and concise presentation of available 
programming by using tbe multiple title objects (61 1A through 61lC)in a 
coordinated fashion with appropriate channel content objects (610-1 through 
' 610-8) and timeslot objects (605A through 605C). In this manner, more 
5 information may be provided on the screen without a deleterious impact to 
the subject viewing quality of the IEPG display. 

It should be noted that while the channel content object 610-1 
through 610-8 are described as comprising three title objects 611A through 
611C, more or less title objects may be displayed or provided. Similarly, 
10 while three timeslot objects 605A-605C are described, more or less time slot 
objects may be utilized. Advantageously, by including more timeslot objects 
or more title objects the total number of video streams needed to represent 
the program guide is reduced. For example, in a system having 80 
channels, ten video PIDS are required to represent respective 8-channel 
15 portions of the available channels. Moreover, while the display is shown 
with 8 channel content objects 610-1 through 610-8, more or fewer channel 
' content objects may be displayed. The present embodiments using three 
time slot objects associated with a respective three title objects and within 8 
channel content objects provides pleasing display imagery on current 
20 display devices such as NTSC, PAL, and SECAM television screens. As 
increased resolution display devices become more readily available, the 
amount of title objects within each channel content object may be increased 
(thereby increasing the number of timeslot objects represented in a single 
screen) and/or the amount of channel content objects may be increased 
25 without any significant degradation in display quality. 

An important aspect of the invention is the program description 
object 650. The program description 650 describes information relating to a 
presently emphasized title of a presently indicated channel. The presently 
emphasized title is that title associated with a presently emphasized 
30 timeslot within the presently indicated channel. The combined features of 
the program description object and the various emphasis and de-emphasis 
protocols developed with respect to the present invention provide a high 
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quality navigation experience to the interactive electronic program guide 
viewer. 

In a system comprising 80 channels, where channels are displayed in 
8-channel groups having associated with them three half hour time slots, it 
5 is necessary to provide 10 video PIDs to carry the present-time 

channel/time/title information, one audio PID to carry the audio barker 
and/or a data PID (or other data transport method) to carry the program 
description data, overlay data and the like. To broadcast program 
information up to 24 hours in advance, it is necessary to provide 128 
10 (8*24/1.5) video PIDS, along with one audio and, optionally, one or more 
data PIDs. The amount of time provided for in broadcast video PIDs for the 
given channel groups comprises the time depth of the program guide, while 
the number of channels available through the guide (compared to the 
number of channels in the system) provides the channel depth of the 
15 program guide. In a system providing only half of the available channels 
via broadcast video PIDs, the channel depth is said to be 50%. In a system 
providing 12 hours of time slot "look-ahead; 1 the time depth is said to be 12 
hours. In a system providing 16 hours of time slot "look-ahead" and 4 hours 
of time slot "look-back," the time depth is said to be +16/-4 hours. 
20 These video streams for the IEPG display may be included as a PES 

within a single transport stream. Thus, a user desiring to view the next 1 V2 
hour time interval (e.g., 9:30 - 11:00) may activate a "scroll right" object (or 
move the joystick to the right when a program within program grid 150 
occupies the final displayed time interval). Such activation will result in 
25 the controller of the STT noting that a new time interval is desired. The 
video stream corresponding to the new time interval will then be decoded 
and displayed. If the corresponding video stream is within the same 
transport stream (Le., a new PID), then the stream will be immediately 
decoded and presented. If the corresponding video stream is within a 
30 different transport stream, then the different transport stream will be 

extracted from the broadcast stream and the appropriate video stream will 
be decoded and presented. If the corresponding transport stream is within a 

SUBSTITUTE SHEET (RULE 26) 



WO 00/64169 PCT/USOO/10059 



-37- 



different broadcast stream, then the different broadcast stream will be 
tuned, the different transport stream will be extracted from the different 
broadcast stream and the appropriate video stream will be decoded and 
presented. 

5 Similarly, a user interaction resulting in a prior time interval or a 

different set of channels will result in the retrieval and presentation of an 
appropriate video stream. If the appropriate video stream is not normally 
part of the broadcast video streams, then a pointcast session is initiated. 
That is, the STT send a request to the head end via the back channel 
10 requesting a particular stream. The head end processes the request, 
retrieves the appropriate stream, incorporates the stream within a 
transport stream as a video PID (ideally the transport stream currently 
being tunes/selected by the STT) and informs the STT which PID should be , 
demultiplexed, and from which transport stream it should be demultiplexed 
15 from. The STT then retrieves the appropriate video PID. In the case of the 
appropriate video PID being within a different transport stream, the STT 
must first demux the different transport stream (possibly even tuning a 
different QAM stream within the forward. channel). 

■ Upon completion of the viewing of the appropriate stream, the STT 
20 indicates to the head end that the STT no longer needs the stream, 
whereupon the head end tears down the pointcast session. It should be 
noted that in one embodiment of the invention, the head end causes 
multiple STTs to "share" a pointcast stream. That is, if a first STT request 
a video stream that is currently being provided to a second STT. the head 
25 end will guide the first STT to the PID and (optionally) transport stream 
providing the video stream to the second STT. If the second STT indicates 
to the head end that it is finished viewing the video stream, the head end 
determines if another STT (i.e., the first STT) is still utilizing the video 
stream. If the stream is still being utilized, the point cast session is not torn 
30 down (at least not with respect to the STT(s) utilizing the video stream). In 
this manner, forward channel bandwidth and head end video processing 
resources are conserved. 
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The above-described sharing of pointcast streams is especially useful 
within the IEPG display context where relatively low channel depth and/or 
time depth is used. In such a case, it is quite likely that several users will 
want to contemporaneously view information that may be packaged within 
5 the same video stream. Thus, an adaptive narrowcast (or group pointcast) 
system is provided, wherein the head end is able to adapt resource 
allocation to the sub-set of users exhibiting a coordinated need for 
information. These adaptive narrowcast session are created and torn down 
as necessary in response to changing user demand. In the event of a very 
10 high level of utilization streams associated with a particular channel 
group(s) or time slots, the head end may determine that the processing, 
memory and bandwidth resources required to create, manage and tear down 
the narrowcast of such streams is greater than the resources required to 
simply provide such streams as broadcast streams, in one embodiment of 
15 the invention the head end will adapt the depth of the broadcast stream to 
accommodate the high utilization stream(s). This accommodation does not 
require the addition of contiguous channel groups or time slots, only the 
addition of PIDs allocate to the high utilization stream(s). 

It is important to note that each extracted video stream is associated 
20 with a common audio stream. Thus, the video/audio barker function of the 
program guide is continuously provided, regardless of the selected video 
stream. 

FIG. 7A depicts a diagrammatic representation of a multiple program 
transport stream suitable for use in the interactive information distribution 

25 system of FIG: 4. Specifically, FIG. 7A depicts a diagrammatic 
representation of a system stream 710 and a transport stream 720. 

The system stream 710 comprises, illustratively, a quadrature 
amplitude modulation (QAM) system stream conveyed by a forward channel 
within the DIVA VOD system. Specifically, the system stream 710 

30 comprises a plurality of transport streams, including transport streams A-H 
(711-717). Each of the transport streams include at least one of video, audio 
or data elementary streams or packetized elementary streams (PES). Each 
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elementary stream within the system stream 710 has associated with it a 
unique packet identification (PID) number. 

The transport stream 720 depicts an exemplary plurality of 
elementary streams associated with a first transport stream 711 (denoted as 
5 stream A) and a second transport stream 712 (denoted as stream B). 
Specifically, first transport stream 711 (Le., stream A) comprises five 
elementary streams (721-725), each of which has associated with it a 
respective PID. The five elementary streams (721-725) of stream A are used 
to provide video, audio and graphics/data information to a set top terminal 
10 such that the set top terminal is capable of producing, via a display device, 
an IEPG display such as described above with respect to FIG. 1 and FIG. 6. 
The utilization of the transport stream 720 will now be discussed with 

respect to FIG. 7B. 

In the exemplary embodiment of the invention, the system stream 
15 710 comprises a constant bitrate stream having a bitrate of 3.37125 million 
bits per second (Mbps), each video PES has a bitrate of 1.05 Mbps, each 
audio PES has a bitrate of 192 Kbps (44.1kHz audio) or 224 Kbps (44kHz 
audio) while the remaining bandwidth is utilized by data streams, overhead 
and the like. It will be appreciated by those skilled in the art that the 
20 bitrate of any of these streams may be adapted to, e.g., provide minimum 
video and/or audio quality levels, provide maximum video and/or audio 
quality levels, to provide for a maximum number of video and/or audio 
elementary streams within a transport stream and other system design 
criteria. The exemplary bitrates are only provided to give a sense of the 
25 bandwidth utilization of a presently employed system utilizing the 

teachings of the invention. The actual bitrates will increase or decrease as 
the system is upgraded and the like. 

FIGS. 7B through 7E depict respective tabular representations of 
exemplary utilizations of a single program transport stream providing 
30 program guide information and suitable for use in the multiple program 
transport stream of FIG. 7A. Specifically, each of the disclosed data 
structures provides one or more video streams for carrying image guide and 
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image region image information. The IEPG displays may be provided 
entirely in a single transport stream (FIG. 7E), in individual transport 
streams (FIG. 7D), in groups within transport streams (FIG. 7A) and in 
overlapping groups within transport streams (FIG. 7B). Each of the data 
5 structures described in FIG. 7A-7D may be readily produced using the 
server-side or head end apparatus described above with respect to FIG. 4. 

FIG. 7D depicts a tabular representation of an exemplary utilization 
of a pair of single program transport streams providing program guide 
information and suitable for use in the multiple program transport stream 
10 of FIG. 7A. Specifically, FIG. 7D depicts a tabular representation 700D of a 
single program data structure for carrying program guide information. 
That is, each of the single program transport streams (A-H) of the multi- 
program transport stream 710 comprises a single video PID, a single audio 
PID and, optionally, a data PID. Thus, a single program transport stream 
15 is required for each video PID. As previously noted, the information 
normally included within the data PID may be included within, e.g., a 
private data field or other location within the included video stream or 
audio stream. 

Referring now to the tabular representation 700D of FIG. 7D f a first 
20 single program transport stream A comprises a video stream having 

associated with it a PID of 1 that contains IPG display screen image data 
related to channels 1-8; an audio stream having associated with it a. PID of 
2 that contains an audio track or audio barker for the video barker 120 of 
FIG. 1 or 620 of FIG. 6; and a data stream including overlay information, 
25 program or title description information or other information suitable for 
providing the IPG functionality. Similarly, a second a single program 
transport stream B comprises a video stream having associated with it a 
PID of 1 that contains IPG display screen image data related to channels 9- 
16; an audio stream having associated with it a PID of 2 that contains the 
30 same audio track or audio barker contained in the first single program 
transport stream A, and a data stream associated with the channel 1-8 
video stream (including overlay information, program or title description 
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information or other information suitable for providing the IPG 
functionality). 

FIG. 7E depicts a tabular representation of an exemplary utilization 
of a single program transport stream providing program guide information 
5 and suitable for use in the multiple program transport stream of FIG. 7 A 
The data structure of FIG. 7E is denoted by the inventor as a "super- 
ganging" data structure. Specifically. FIG. 7E depicts a tabular 
representation 700E of a multiple program data structure for carrying all of 
the program guide information. That is, one of the single program transport 
10 streams (A-H) of the multi-program transport stream 710 is used to provide 
the necessary video PIDs to contain ah of the IEPG displays to be provided 
in broadcast mode. 

Referring now to the tabular representation 700E of FIG. 7E. a single 
program transport stream A comprises N video streams, each of the N video 
15 streams being associated with a respective PID and containing IPG display 
screen image data related to a respective channel group (illustratively an 
eight channel group); an audio stream having associated with it a PID of 
N+l; and a data stream having associated with it a PID of N+2. 

Advantageously, the "super-ganging" data structure provides for the 
20 most rapid changes between video PIDs. since each video PID is within the 
same transport stream. 

FIG. 7B depicts a tabular representation of an exemplary utilization 
of a pair of single program transport streams providing program guide 
information and suitable for use in the multiple program transport stream 
25 of FIG. 7A The data structure of FIG. 7B is denoted by the inventor as a 
"ganging" data structure. Specifically. FIG. 7B depicts a tabular 
representation 700B of a multiple program data structure wherein each 
transport stream comprises a respective plurality of program guide 
information. That is. two or more of the single program transport streams 
30 (A-H) of the multi-program transport stream 710 are used to provide the 
necessary video PIDs to contain all of the IEPG displays to be provided in 
broadcast mode. 
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Referring now to the tabular representation 700B of FIG. 7B, each of 
a first A and second B single program transport stream comprises a 
respective three video streams, each of the three video streams being 
associated with a respective PID and containing IPG display screen image 
5 data related to a respective channel group (illustratively an eight channel 
group); a respective audio stream having associated with it a PID of 4; and 
a respective data stream having associated with it a PID of 5. 

Advantageously, the "ganging" data structure provides for rapid 
changes between video PIDs, where the video PID to be selected is within 
10 the same transport stream as the video PID presently selected. Moreover, 
the "ganging' data structure allows for the construction of relatively small 
transport streams, compared to the "super-ganging" structure described 
above with respect to FIG. 7E. 

FIG. 7C depicts a tabular representation of an exemplary utilization 
15 of a single program transport stream providing program guide- information 
and suitable for use in the multiple program transport stream of FIG. 7 A 
The data structure of FIG. 7C is denoted by the inventor as an "overlapping 
ganging" data structure. Specifically, FIG. 7C depicts a variation of the data 
structure described above with respect to FIG. 7B. In the data structure of 
20 FIG. 7C, each single program transport stream (A-H) comprises at least one 
video PID that contains an IPG display of a channel gTOup that duplicates 
the contents of a video PID found in another single program transport 
stream. By contrast, the data structure of FIG. 7B does not "duplicate the 
IPG display of a channel group. The "overlapping ganging' 1 structure 
25 utilizes a multiple program data structure wherein each transport stream 
comprises a plurality of program guide information, including overlapping 
program guide information. That is, two or more of the single program 
transport streams (A-H) of the multi-program transport stream 710 are 
used to provide the necessary video PIDs to contain all of the IEPG displays 
30 to be provided in broadcast mode. 

Referring now to the tabular representation 700C of FIG. 7C, each of 
a first A, second B and third C single program transport stream comprises a 
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respective three video streams, each of the three video streams being 
associated with a respective PID and containing IPG display screen image 
data related to a channel group (illustratively an eight channel group); a 
respective audio stream having associated with it a PID of 4; and a 
5 respective data stream having associated with it a PID of 5. 

Referring to the second B single program transport stream, the first 
video PID contains channel group 9-16, the second video PID contains 
channel group 17-24 and the third video PID contains channel group 25-32. 
Note that the first video PID of the second B single program transport 
10 stream contains the same channel group as the third video PID of first A 
single program transport stream; and that the third video PID of the second 
B single program transport stream contains the same channel group as the 
first video PID of third C single program transport stream. 

Advantageously, the "overlapping ganging" data structure provides 
15 for rapid changes between video PIDs, where the video PID to be selected is 
within the same transport stream as the video PID presently selected. 
Additionally, since each the contents of first and/or last video PIDs are 
included within two transport streams, the STT can utilize stream priming 
methods to select the second transport stream and transition the user to 
20 viewing the same IEPG display, but derived form a video stream within the 
second transport stream. In this manner, delays experienced by the user of 
the STT in changing from one transport stream to another are reduced, 
since the change is actually executed as a background process. Thus, the 
use of the "overlapping ganging" data structure and the stream priming 
25 technique provides most of the advantages of the "super-ganging" structure, 
but without the use of very large transport streams. 

While the ganged 700B and overlapping 700C data structures are 
depicted as including only three video streams, each of these data structures 
may include more or fewer video streams. In one embodiment of the 
30 invention, each of the single program transport stream (A-H) comprises 10 
video PIDS. In the case of the overlapping 700C data structure, the first 
video PID of each stream contains the same channel group as the last video 
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PID of the preceding stream. Similarly, the last video PID of each stream 
contains the same channel gTOup as the first video PID of the next stream. 
The terms "preceding" and "next" within this context indicate streams that 
carry contiguous EIPG display information, in either a channel-sense (e.g., 

5 adjoining channel groups) or a time slot sense (e.g., adjoining time slots). 

An important aspect to the invention is the "stream priming" aspect. 
Stream priming is a method of anticipating that a particular stream will be 
required and requesting that stream prior to the actual need for that 
stream. For example, where a user receiving a pointcast IEPG stream has 

10 traversed to within a threshold level of the upper or lower channel or time 
slots displayed, it is likely that the user will continue past the channel or 
time slot boundaries of the IEPG display. In this case, when the user 
reaches the threshold level, a the STT send a request for the appropriate 
next to the head end of the system. The head end processes the request and 

15 begins delivering the appropriate stream. In the case of the appropriate 
stream being delivered via the same transport stream currently being 
demultiplexed by the STT (a preferred embodiment), the STT simply selects 
the PID of the appropriate stream when the user exceeds the upper or lower 
channel or time slots displayed. In this manner, the latency inherent in 

20 requesting and receiving the appropriate stream is greatly reduced. 

The first video stream (PID 1) comprises all the information 
.necessary to produce a video layer for the IEPG display 600 of -FIG. 6, 
including channel content objects 610-1 through 610-8 associated with 
channels 1-8 for a defined time period. The second video stream (PID 2) and 

25 third video stream (PID 3) differ from the first video stream (PID 1) in that 
the second video stream (PID 2) and third video stream (PID 3) comprise the 
information necessary to produce a video layer including channel content 
objects 610-1 through 610-8 associated with, respectively, channels 9-16 and 
channels 17-24. 

♦ 30 The audio stream (PID 4) comprises the audio information necessary 

to produce the audio barker associated with the video barker 620 (e.g., the 
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voice-over of a movie trailer displayed within the video barker 620 of the 
image region of the display. 

The data/graphics stream (PID 5) comprises the title description 
information that is displayed as the program description object 650. That 

5 is, data/graphics stream (PID 5) comprises a textual description of each title 
provided by channels 1-8 for each of the displayed time slots (e.g., three half 
hour slots). The textual description of the titles is processed by the graphics 
processing elements of the STT such that the textual description of a 
presently highlighted or emphasized title of an indicated channel is 

10 presented to a viewer via the graphics layer of the IEPG display 600 of FIG. 
6. 

It is important to note that graphics and/or data information may be 
conveyed to a set top terminal using a data stream associated with a unique 
PID (as depicted here), as private data within the adaptation headers of the 
15 transports stream packets or by other means (e.g., encoded within the video 
data using, e.g., watermarking techniques). Moreover, since the data 
stream is used to convey program identification data or other data that does 
not need to be provided in real time, such data may be used to build a local 
database of, e.g., favorite programming and the like. However, the favorite 

20 programming database does not comprise a program guide database. 

Rather, the favorite programming database comprises sufficient information 
to identify the favorite program or title, illustratively, the transport stream 
and video PID providing the appropriate channel group, an index into the 
channel group (e.g., third channel from start), an index into the time slots 

25 (e.g., second time slot) and the like. There is no need to store the actual title 
of the program, only to determine which titles should be highlighted or 
emphasized in a favorite viewing mode. 

Referring now to FIG. 7B, transport stream A comprises three video 
PES streams having respective PID values or 1, 2 and 3. Each video PES 

30 includes video information for providing the video layer of a program guide 
display, such as depicted above with respect to FIG. 1 and FIG. 6. Each 
video PES stream has associated with it the channel guide information of a 
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respective plurality of channels. Within the context of the program guide 
display of FIG. 1, each video PES includes channel guide information 
associated with a respective 10 channels arranged according the grid 
display described above with respect to FIG. 1. Within the context of the 
5 program guide display of FIG. 6,.each video PES includes channel guide 
information associated with a respective 8 channels arranged according the 
mask and reveal display described above with respect to FIG, 6. 

FIG. 8A depicts a contextual flow diagram useful in understanding 
the invention. Specifically, the contextual flow diagram 800A of FIG. 8A 
10 depicts changes in the contextual flow of the IEPG display screen 600 in 
response to horizontal increment and decrement (rightAeft) commands, such 
as right arrow and left arrow key activations from, e.g., a remote control. 
Each of the objects depicted in the contextual flow diagram comprises a 
video object having associated with it a graphics object or overlay providing 
15 emphasis to indicate an active (i.e. f selectable) object or de-emphasis to 
indicate a non-active object (Le., non-selectable). 

The objects depicted in the contextual flow diagram 800A of FIG. 8A 
comprise a subset of the objects depicted in the IEPG display screen 600 of 
FIG. 6. Specifically, the objects depicted in the contextual flow diagram 
20 800A of FIG. 8A comprise, in the order of emphasis in response to a right 
arrow or horizontal increment: the first 605A, second 605B and third 605C 
time slot objects of the IPG display screen guide region. These objects are 
followed by the following IPG display screen image region objects: day of 
week identification object 631, next time slot object 634, "favorites" filter 
25 object 635, "movies" filter or video on demand (VOD) selection object 636, a 
"kids" filter or VOD selection object 637 and "sports" filter or VOD selection 
object 638. It should be noted that while the objects depicted in the 
contextual flow diagram 800A comprise objects depicted in the IEPG display 
screen 600, the IEPG display 100 of FIG 1 and other IPG display screens 
30 may be adapted accordingly. 

For purposes of this discussion it will be assumed that the first object 
to be highlighted or emphasized is the first time slot object 605A. Referring 
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now to FIG. 8A, in response to a first right arrow or horizontal increment 
801, the first time slot object 605A is de-emphasized and the second time 
slot object 605B is emphasized; in response to a second right arrow or 
horizontal increment 802, the second time slot object 605B is de-emphasized 
5 and the third time slot object 605C is emphasized; in response to a third 
right arrow or horizontal increment 803, the third time slot object 605C is 
de-emphasized and the day of week identification object 631 is emphasized, 
and so on for the (804) next time slot object 634; (805) "favorites" object 635; 
(806) "movies" selection object 636; (807) "kids" selection object 637; (808) 
10 "sports" selection object 638 and, finally, the (809) first time slot object 
605A. 

The graphical depiction of FIG. 8A is divided into those objects 
associated with an active guide region (the three timeslots 605A-605C) and 
those objects associated with an active image region (the remaining objects 
15 631-638). This delineation is used to determine the functionality of vertical 
increment (up arrow), vertical decrement (down arrow), page up and page 
down keys. The differences between guide region and image region key 
functionality will be discussed in more detail below with respect to FIGS. 8B 
and 9A (guide region functionality) and FIGS. 8C and 9B (image region 

20 functionality). 

When the guide region is active (any of objects 605A-605C 
emphasized), the up and down arrow keys are used to scroll through the 
various portions of the guide region. That is, the presently indicated (via 
channel indicator objects 641A and/or 641B) channel content object (610-1 

25 through 610-8) is changed by one (Le., incremented or decremented) in 
response to up arrow or down arrow activation. Similarly, the displayed 
video stream is changed (via selecting the next or prior video PID) in 
response to page up or page down key activation. Thus, active guide region 
functionality provides for navigation of the various video streams providing 

30 broadcast IPG screens to a user. 

When the image region is active (any of objects 631-638 emphasized), 
the up and down arrow keys are used to adjust the presently indicated next 
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time slot object 634, while the page up and page down keys are used to 
adjust the day of week identification object 631. Specifically in response to 
an up arrow key activation, the presently indicated next time slot object 634 
is incremented by, e.g., 1 V* hours by selecting the video PID including the 

5 guide information for the next three time slots of the current channels 
presented in the guide region. Similarly, in response to a page up key 
activation, the presently indicated day of week identification object 631 is 
incremented by 1 day by selecting the video PID including the guide 
information for the next day of the current channels presented in the guide 

10 region. 

In the case of a "deep time" broadcast of guide information (i.e., 
broadcast of present, future and/or past guide information on appropriate 
video streams), the broadcast video PID including the appropriate guide 
screen is selected. If such a broadcast video PID is not available, then the 

15 STT makes a request for such a stream via the back channel (Le., a 
PointCast mode is entered). Upon tuning and/or demultiplexing the 
transport stream including the*requested pointcast or narrowcast video PID, 
the requested video PID is selected and, if necessary, a different audio 
stream and data stream is selected. 

20 FIG. 8B depicts a contextual flow diagram useful in understanding 

the invention. Specifically, the contextual flow diagram 800B of FIG. 8B 
depicts changes in the contextual flow of the IEPG display screen 600 in 
response to vertical increment and decrement (up/down) commands received 
while a guide region object is highlighted or emphasized. 

25 The objects depicted in the contextual flow diagram 800B of FIG. 8B 

comprise a subset of the objects depicted in the IEPG display screen 600 of 
FIG. 6. Specifically, the objects depicted in the contextual flow diagram 
800B of FIG. 8B comprise the channel content object 610-1 through 610-8 as 
indicated by the channel indicator objects 641A and/or 641B. In response to 
" 30 successive down arrow or vertical decrement key activations, the indicated ■ 
channel content object traverses from 610-1 to 610-2 (820); 610-2 to 610-3 
(621); 610-3 to 610-4 (822); 610-4 to 610-5 (823); 610-5 to 610-6 (824); 610-6 
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to 610-7 (825) and 610-7 to 610-8 (826). Similarly, activating an up arrow or 
vertical increment key changes the indicated channel in the reverse 
manner. 

In response to a down arrow activation while channel object 610-8 is 
5 indicated, the "next" video PID is selected for display. That is, the video 
PlD containing the next eight channels to be displayed for the currently 
viewed time slot is selected. If the last eight channels are presently being 
displayed, than the video PID associated with the first eight channels is. 
selected (i.e., channel "roll-over"). In the case of the "next" video PID being 
10 part of a different transport stream (i.e., a "next" transport stream), it is 
first necessary to tune and/or decode the next transport stream to extract 
(i.e., demultiplex) the appropriate video PID and the associated audio and 
data PIDs. 

In response to an up arrow activation while channel object 610-8 is 
15 indicated, the "prior" video PID is selected for display. That is, the video 
PID containing the prior eight channels to be displayed for the currently 
viewed time slot is selected. If the first eight channels are presently being 
displayed, than the video PID associated with the last eight channels is 
selected (Le., channel "roll-under") In the case of the "prior" video PID being 
20 part of a different transport stream (i.e., a "prior" transport stream), it is 
first necessary to tune and/or decode the next transport stream to extract 
(i.e., demultiplex) the appropriate video PID and the associated audio and 
data PIDs. 

If the system is in a pointcast mode when the need change the 
25 displayed channel arises, then the issue of latency must be addressed. 

Specifically, select a pointcast PID it is first necessary to request such a PID 
from the head end of the system. Ideally, the requested PID will be 
conveyed to the requesting STT via the same transport stream presently 
being tuned and demultiplexed by the requesting STT. In one embodiment 
30 of the invention, the head end will adjust, e.g., the program map table 

(PMT) or program association table (PAT) of the transport stream including 
the requested PID such that the STT may determine which video PID (and 
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possibly which audio and data PIDs) should be selected to realize the 
channel roll-over or roll-under function. 

To reduce latency in requesting a PID during pointcast or narrow cast 
mode, the STT optionally issues a request prior to the traversal of the first 
5 610-1 or last 610-8channel content object. Specifically, FIG. 8B depicts the 
requesting 831 of a next channel PID contemporaneous to the indicated 
channel content object traversal of 610-6 to 610-7 (825); and the requesting 
830 of a prior channel PID contemporaneous to the indicated channel 
content object traversal of 610-3 to 610-2 (821). Thus, when the actual roll- 
10 over 827 or roll-under 827 channel content object traversal is desired, the 
appropriate next or prior video PID is likely to be readily available, thereby 
masking the latency in procuring the video PID during the pointcast or 
narrowcast mode. The above-described latency masking technique allows 
more rapid acquisition of an appropriate next or prior PID atthe expense of 
15 providing multiple PIDs to a single STT. 

FIG. 8C depicts a contextual flow diagram useful in understanding 
the invention. Specifically, the contextual flow diagram 800C of FIG. 8C 
depicts changes in the contextual flow of the IEPG display screen 600 in 
response to vertical increment and decrement (up/down) commands received 
20 while an image region object is highlighted or emphasized. 

The object depicted in the contextual flow diagram 800C of FIG. 8C 
comprises the next time slot object 634 depicted in the IEPG-display screen 
600 of FIG. 6. Specifically, when an image region object is activated, the 
next time slot object 634 is incremented or decremented in response- to, 
25 respectively, an up arrow or vertical increment key activation and a down 
arrow or vertical decrement key activation. In the exemplary embodiment, 
the next time slot object 634 is delineated in 1 Vi hours intervals (i.e., the 
time slot following the three time slots 605A, 605B and 605C of the guide 
region) for a 24 hour period. 
30 In one embodiment of the invention, the operations described in the 

contextual flow diagram 8C only occur if the next time slot object 634 or a 
combined object comprising the day object 631 and next time slot object 634 
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are highlighted or emphasized. In another embodiment of the invention, 
the operations described in the contextual flow diagram 8C occur when any 
image regions object is highlighted or emphasized. 

In response to successive up arrow or vertical increment key 
5 activations, the indicated next time slot object traverses from the actual 
(with respect to the present time) next time slot (851) to a next time slot + 3 
(852) via path 8512; a next time slot + 6 (853) via path 8523; a next time 
slot + 9 (854) via path 8534 and so on up to a next time slot + 21 (858) via 
path 8578. An additional up arrow or vertical increment key activation 
10 results, in the present embodiment, in a return to the next time slot (851) 
via path 8581. Similarly, activating a down arrow or vertical decrement key 
changes the indicated next time slot object in the reverse manner, except for 
one case. Specifically, in the case of activating a down arrow or vertical 
decrement key when the next time slot (851) is indicated, the system enters 
15 a time shift mode 856 via path 8516. 

The time shift mode 856 comprises the retrieval, via pointcast, of 
video PID associated with programming that has already been presented. 
That is, the time shift mode comprises a mode of retrieving previously 
broadcasted programming, such as network programming, sporting events 
20 and the like. Upon entering this mode, the STT user interacts with the 
server to arrange for the selection and/or payment of such time shifted 
programming material. It is noted that the programming guide information 
associated with time shifted material may be incomplete due to business- 
related restrictions on time shifting or "second broadcast" programming. 
25 However, in the case where the head end of the system records all the 
content of each channel for a predefined period of time (e.g., 2 weeks), the 
title and prior presentation time of the recorded programming material is 
viewed and selected using the IPG screens of the present invention. 

FIG. 9A depicts a contextual flow diagram useful in understanding 
30 the invention. Specifically, the contextual flow diagram 900A of FIG. 9A 
depicts changes in the contextual flow of the IEPG display screen 600 in 
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response to page up and page down commands received while an object 
within the image region is highlighted or emphasized. 

The changes in contextual flow of the contextual flow diagram 900A 
of FIG. 9A comprise the selection of a video PID including the presently 
5 viewed time slots of channels prior to (page up) or after (page down) the 
channels of the presently selected video PID, when a guide region object is 
activated. 

In response to successive page up key activations, the following 
traversals are made: from a present channels PID 901 to a prior channels 

10 PID 902 via path 9012, from the prior channels PID 902 to the second prior 
channels PID (not shown) and so on up to the first channels PID 903 via 
path 9023. Further in response to successive page up key activations, the 
following traversals are made: from the first channels PID 903 to a last 
channels PID 904 via path 9034, from the last channels PID 904 to a second 

15 from last prior channels PID (not shown) and so on up to a next channels 
PID 905 via path 9045 and from the next channels PID 905 to the present 
channels PID 901 via path 9051. 

In response to successive page down key activations, the following 
traversals are made: from the present group of channels PID 901 to the next 

20 group of channels PID 905 via path 9051, from the next group of channels 
PID 905 to the second next group of channels PID (not shown) and so on up 
to the last group of channels PID 904 via path 9045. Further in response to 
successive page down key activations, the following traversals are made: 
from the last group of channels PID 904 to the first group of channels PID 

25 903 via path 9034, from the first group of channels PID 903 to a second 
group of channels PID (not shown) and so on up to the prior group of 
channels PID 902 via path 9023 and from the prior group of channels PID 
902 to the present group of channels PID 901 via path 9012. 

In one embo dim ent of the invention, changing PIDs will yield a guide 

30 image in which either the corresponding channel content object, the first 
channel content object, the last channel content object or a predetermined 
channel content object is indicated. 
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FIG. 9B depicts a contextual flow diagram useful in understanding 
the invention. Specifically, the contextual flow diagram 900B of FIG. 9B 
depicts changes in the contextual flow of the IEPG display screen 600 in 
response to page up and page down commands received while an image 
. 5 region object is highlighted or emphasized. 

The changes in contextual flow of the contextual flow diagram 900B 
of FIG. 9B comprise the selection of a video PID including the presently 
viewed time slots of the presently viewed group of channels prior one day in 
advance of (page up) or one day prior to (page down) the channels of the 

10 presently selected video PID, when a guide region object is activated. 

In one embo dim ent of the invention, the operations described in the 
contextual flow diagram 9B only occur if the day object631 or a combined 
object comprising the day object 631 and next time slot object 634 are 
highlighted or emphasized. In another embodiment of the invention, the 

15 operations described in the contextual flow diagram 9B occur when any 
image regions object is highlighted or emphasized. 

In response to successive page up key activations, the following 
traversals are made: from a present day PID 921 to a next day PID 922 via 
path 9212; from the next day 922 to a second next day 923 via path 9223 

20 and so on up to a week ahead PID 924 via a path 9234 and from the week 
ahead PID 924 to the present day PID 921. 

In response to successive page down key activations, the following 
traversals are made: from the week ahead PID 924 to a week ahead minus 
one day PID (not shown) and so on to the next day PID 922 via paths 9234 

25 and 9223 and to the present day PID 921 via paths 9212. In the case of a 
page down key activation when the present day PID object is highlighted, 
the system enters the time shift mode described above via path 9251. 
Within the time shift mode 925 page up and page down keys may be used to 
reach back in time to the extent allowed by the system, based upon the 

30 amount of programming recorded for subsequent re-presentation to the 
user. 
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FIG. 10 depicts a tabular representation of the functions of various 
keys during guide region and image region operation. The functions of some 
of the depicted keys have been described above and, therefore, will not be 
additionally discussed. Specifically, FIG. 10 depicts the guide region and 
5 image region functionality of the increment (up arrow), decrement (down 
arrow) page up, page down, horizontal increment (move right), horizontal 
decrement (move left) select and add/remove keys. The Select key is used to 
select a highlighted or emphasized object to, e.g., enter a different operating 
mode (image region response) of tune an indicated channel (guide region 

10 response). The add/remove key is used to add a presently tuned channel to 
the list of favorites. If the presently tuned channel is already on the list, 
then the channel is removed form the list of favorites. Optionally, the 
viewer is queried as to whether the viewer really intends to remove the 
channel from the favorites list. 

15 FIGS. 11A-11C, 12A-12C, 13 and 14 depict respective display screens 

of an interactive electronic program guide (IEPG) displays useful in 
understanding the invention. These IEPG displays are similar to the IEPG 
display 600 depicted above with respect to FIG. 6. The IEPG displays of 
FIGs. 11-14 depict different aspects of the invention, including variations of 

20 a "hide and reveal" aspect of the present invention. 

Referring to FIG. 11A, the IEPG display 1100A of FIG. 11A comprises 
a first 605A, second 605B and third 605C timeslot object, a plurality of 
channel content objects 610-1 through 610-8, a pair of channel indicator 
objects 641A, 641B, a video barker 620 (and associated audio barker), a 

25 cable system or provider logo 615, a program description object 650, a day of 
week identification 631, a time of day object 639, a next timeslot object 634, 
a temporal increment/decrement object 632, a "favorite" filter or selection 
object 635, a "movies" filter or selection object 636, a "kids" filter or selection 
object 637, a "sports" filter or selection object 638 and a video on demand 

30 (VOD) selection object 633. 

To simplify the discussion, the various reference designators used to 
describe elements of FIG. 11A will generally not be replicated in FIGS. 11B- 
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14. However, a textual reference to a reference designator within one of 
FIGS. 11A-14 should be interpreted as a textual reference to the element of 
the one figure corresponding to the element so designated within FIG. 11A. 
With the exception of the separate video on demand object 633, the 
5 IEPG display 1100A of FIG. llAis substantially the same as the IEPG 
display 600 of FIG. 6. The primary difference between the display screens 
1100A and 600 of FIGS. 11A and 6 are as follows: First, in the IEPG 
display 1100 of FIG. 11A, the first time slot 605A is emphasized in that this 
time slot is depicted as a light or high intensity object, while the second 
10 605B and third 605C timeslot objects are depicted as low intensity objects. 
Additionally, the first title object 611A of each of the channel content objects 
610-1 through 610-8 is emphasized in that each of these objects is presented 
in a fall intensity color (illustratively black) while the second 611B and 
third 6 11C title objects are presented in a muted intensity color. In the 
15 IEPG display 1100A of FIG. 11A the muted intensity is achieved in the 
previously described manner by, e.g., adapting the opacity of the graphic 
layer to, e.g., 25%, 50% or 75% -opacity, while the emphasized objects retain 
0% opacity (i.e., no reduction in brightness). 

The difference between the various IEPG displays depicted in FIGS. 
20 11A through 14 will now be described. FIG. 11A through 11C depict 

program guide display screens 110A through 1100C in which the opacity of 
the title object to be emphasized is set to 100%, while the opacity of the title 
objects to be de-emphasized is set to 75%, 50%, 25% or some other 
percentage suitable for providing a visual demarcation to the viewer. 
25 Referring to FIGS. 11A-11C, it can be seen that the first time slot 

605A is highlighted in a display screen 1100A of Figure 11A, the second 
time slot, 605B is highlighted in the display screen 1100B of Figure 11B, 
and the third time slot 605C is highlighted in the display screen 1100C of 
Figure 11C. In this manner, a viewer navigating the program guide is 
30 presented with a clear emphasis on the time slot and channel corresponding 
to an emphasized title object that is associated with the information within 
the title description object 650. 
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Referring now to Figure 12A, it is noted that the first time slot 605A 
is emphasized and that only the first title object 61 1A within each of the 
channel content objects 610 is shown. That is, only the title object 
associated with the emphasized time slot is "revealed," while the title 
5 objects associated with the non-emphasized time slots are "hidden." This 
"hide and reveal" method of presentation provides a IEPG display that some 
people find more desirable than the previously described (with respect to 
Figures 11A through 11C) muting or reduced opacity de-emphasis method of 
presentation. However, the muting or reduced opacity de-emphasis method 
10 of presentation does present more information to the viewer in each IEPG 
display. 

Referring now to FIGS. 12A through 12C, FIG. 12A depicts a IEPG 
display 1200A having the first time slot 605A emphasized and each of the 
title objects 611A associated with that first time slot being revealed, while 

15 each of the title objects 611B, 611C associated with the non-emphasized 
time slots 605B and 605C are hidden. In FIG. 12A the first time slot object 
is emphasized and the second and third time slots are de-emphasized; in 
FIG. 12B the second time slot object is emphasized, while the first and third 
time slot objects are de-emphasized; and in Figure 12C the third time slot 

20 object is emphasized while the first and second time slot objects are de- 
emphasized. Note that in all cases the operation of the title description 
object 650 remains unchanged, as does the operation of the video barker 120 
and all the other functional elements of the program guide. 

Figure 13 depicts an IEPG display 1300 that is substantially the 

25 same as depicted and described above with respect to FIG. 11A. The 
difference between the IEPG displays 1300 of FIG. 13 and 1100A of FIG. 
11A comprise the use of the next time slot object 634. Specifically, referring 
now to FIG. 11A, the next time slot object 634 indicates that the next time 
slot is 9:30 p.m. This is correct since the third time slot object 605C is 9:00 

30 . and the time slots in the exemplary embodiment comprise one half hour 
each. 
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As previously described with respect to FIG. 8C, in the case of the 
image region being active, activations of up or down arrows by, a user via a 
-rwxiute control device, result in incrementing and decrementing the 
indicated time slot within the next time slot object 634. Upon receiving a 
5 select command, the video PID including the present channel information 
for the time indicated by the selected next time slot object 634 is retrieved. 
In the case of that video stream being part of a currently broadcast or 
currently used video stream (e.g., another user has requested this stream), 
the head end provides information to the set top terminal enabling the set 
10 top terminal to identify which video PID includes the appropriate channel 
guide information. The set top terminal then retrieves the appropriate 
video PID. Of course, where the appropriate video PID is located within a 
different transport stream than the transport stream including the 
presently viewed video PID, it will be necessary to also select the audio PID 
15 from the new transport stream. 

Referring now to Fig. 13, a present time object 634' is shown. 
Specifically, rather than the next time slot object 634 of FIG. 11A, the 
present time object 634' of FIG. 13 depicts the presently emphasized time 
slot or, optionally, the first time slot 605A contents. Thus, in the IEPG 
20 display 1300 of FIG. 13, the present time slot object 634' identifies the 
present time slot as 9:30 p.m., which corresponds to the 9:30 time depicted 
in the first time slot object 605A of FIG. 13. 

Referring now to Figure 14, the IEPG display 1400 depicted in FIG. 
14 is substantially the same as the IEPG display.l200A depicted in FIG. 
25 12A. As previously described above with respect to FIG. 13, the IEPG 

display 1400 of FIG. 14 includes a present time object 634' that is indicative 
of the first time slot object 605A within the guide portion of the IEPG 
display. The present time slot object 634' may be incremented or 
decremented using appropriate up or down arrows to indicate a desired 
30 present time slot, which, upon selection via the SELECT key, will be 

retrieved by the set top terminal and displayed as the IEPG display 1400. 
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The IPG display screen 600 of Figure 6 (and corresponding display 
screens depicted in Figures 11 - 14) is shown with channel content object 
610-1 through 610-8 depicted as a function of time slots 605A - 605C, where 
each channel content object includes three title objects 611A - 611C. In an 
5 alternate mode of operation, time sbt associated with the group of channels 
is described for a larger amount of time. Similarly, fewer objects are 
depicted as a function of channel content objects. That is, a smaller number 
channel objects 610 may displayed, where each channel object include more 
that three title objects 611. 

10 It is important to note source of information for the various 

information elements of the IEPG displays of FIG. 1, 6 and 11-14. 
Specifically, both the guide region and image region of the IEPG displays 
are provided within video streams broadcast, narrowcast or pointcast video 
streams provided by the head end. That is, the program guide information 

15 is assembled at the head end and provided as video information to the STTs 
within the system. Manipulation of video layer objects is accomplished by 
proxy manipulations of graphic layer objects. The STT provides (beyond 
tuning, demultiplexing, decoding and such operations) the ability to 
highlight or emphasize object and select a highlighted or emphasized object. 

20 The graphic information manipulated by the STT is received via a data 
stream (i.e., a data PID), auxiliary data, private data and the like. 
Advantageously, since there is no local storage of an entire program guide 
data base, memory resources of the STT are conserved. Rather, information 
sufficient to e.g., describe a highlighted program title is included within the 

25 aforementioned data stream, which may be contemporaneously transmitted 
to the STT along with the video stream including the channel group/time 
slots including the program title. 

FIGS. 15A and 15B together comprise a user interaction method 1500 
according to the invention. FIG. 15B also depicts a diagram representing an 

30 alignment between 15A and FIG. 15B. The method 1500 of FIG. 15 

comprises a plurality of steps including some that perform substantially the 
same function as depicted above with respect to the user action method 500 
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of FIG. 5. Specifically, steps 504-522 of the user interaction method 500 of 
FIG. 5 operate in substantially the same way as steps 1502-1522 of the user 
interaction method 1500 of FIG. 15. Therefore, these steps will not be 
described in further detail accept where such description indicates changes 
5 or additions to the previously described steps 502-522. 

Referring now to step 1514 of FIG. 15 (which corresponds to step 514 
of FIG. 5), if the query at step 1514 indicates that local interactivity only is 
requested by the user, then the method 1500 proceeds to step 1540, where a 
query is made as to the type of key pressed by the user. If the query at step 
10 1540 indicates that a freeze key has been pressed by the user, then the 
method 1500 proceeds to step 1534, where the video frame presently stored 
in the frame store unit 262 is frozen. That is, the frame store unit 262 is not 
updated by subsequent video frames until such time as a freeze key or other 
key is pressed. The method 1500 then proceeds tor step 1510, where the 
15 processor waits for user input. 

If the query at step 1514 indicates that one of an increment or 
decrement key has been pressed (e.g., a channel indication increment or 
decrement command) then the method proceeds to step 1544. If the query 
at step 1540 indicates that one of a page up or page down key has been 
20 pressed, then the method 1500 proceeds to step 1542. 

At step 1542 a query is made to determine if the one of a page up or 
page down key is, in fact, a page up key. If the query at step, 1542 indicates 
that a page up key has been pressed, then the method 1500 proceeds to step 
1532. If the query at step 1542 indicates that a page down key has been 
25 pressed, then the method 1500 proceeds to step 1526. As previously 

described with respect to FIG. 9A, a page down key pressed while the guide 
region is active indicates a desire to select the video stream including the 
program guide having a next group of channels, while a page up key pressed 
while the guide region is active indicates a desire to select the video stream 
30 including the program guide having a prior group of channels. 

At step 1544 a query is made as to whether an increment key has 
been pressed. If the query at step 1544 is answered affirmatively, then the 
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method 1500 proceeds to step 1546. The query at step 1544 is answered 
negatively (i.e., a decrement key has been pressed), then the method 1500 
proceeds to step 1548. 

At step 1546 a query is made as to whether a last upper channel is 
5 presently being indicated. That is, a query is made as to whether the upper 
most channel of the program guide (i.e., channel content object 610-1) is 
presently indicated by channel indicators 641A and 641B. If the query at 
step 1546 is answered affirmatively, then the method 1500 proceeds to step 
1532. Specifically, if the upper most channel content object 610-1 is 

10 presently indicated, then the satisfaction of the user increment key input 
requires the selection of the video stream including the next channel group 
(Le. f the channel group including a lower channel that is contiguous with 
the presently selected upper channel in a channel guide sense). If the query 
at step 1546 is answered negatively, then the method 1500 proceeds to step 

15 1550. 

At step 1550 a query is made as to whether an upper threshold level 
has been reached. As previously discussed with respect to path 830 of FIG. 
8B f an upper threshold level is a level at which a request for a prior channel 
PID should be made if such a prior channel PID is unavailable. If the query 

20 at step 1550 is answered affirmatively, then the method 1500 proceeds to 
step 1552. If the query at step 1550 is answered negatively, then the 
method 1500 proceeds to step 1558. 

At step 1552 a determination is made as to whether the prior channel 
group is available. An available channel group is a channel group within a 

25 video stream that is presently being broadcast or narrow cast or point cast 
to one or more set top terminals. As previously noted, the set top terminal 
receives information associating each channel group with a particular video 
stream as identified by a unique PID. If the unique PID, or the stream 
associated with the unique PID is not being broadcast, narrow cast or point 

30 cast, then it is appropriate at this time to request that the head end begin a 
point cast session so that the prior channel group may be received by the set 
top terminal without undue delay (e.g., without the user experiencing 
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latency due to the amount of time required to process and respond to a 
request for a video stream). The method 1500 then proceeds to step 1554. 

At step 1554 a query is made as to whether the prior channel group is 
available. If the query at step 1554 is answered negatively, then the 
5 method 1500 proceeds to step 1556, where a request for the prior channel 
group is sent to the head end for processing. The method then proceeds to 
step 1558. If the query at step 1554 is answered affirmatively, then the 
method proceeds to 1558. 

At step 1558 the channel indicator is moved up by one channel 

10 content object 610. That is, the channel content object immediately above 
the presently indicated channel content object is now indicated. The 
method 1500 then proceeds to step 1510, to wait for the next user input. 

If the query at step 1544 is answered negatively, then the method 
1500 then proceeds to 1548. At step 1548 a querjris made as to whether the 

15 presently indicated channel is the last lower channel. That is, a query is 
made as to whether the presently indicated channel is channel content 
object 610-8, per FIG. 6. If the query at step 1548 is answered 
affirmatively, then the method 1500 proceeds to step 1546. It is important 
to note that is the presently indicated channel is associated with channel 

20 content object 610-8, then a decrement command, as noted above with 
respect to FIG. 8B and path 832 requires the selection of the next channel 
PID to display the upper most channel of the next channel group (i.e., 
channel content object 610-1 of the next channel group). If the query at step 
1548 is answered negatively, then the method 1500 precedes to step 1560. 

25 At step 1560 a query is made as to whether a lower threshold has 

been reached. If the query at step 1560 is answered negatively, then the 
method 1500 proceeds to step 1568. If the query at step 1560 is answered 
affirmatively, then the method 1500 proceeds to step 1562. 

At step 1562 a determination is made if the next channel group is 

30 available. This is, in a manner similar to that described above with respect 
to step 1552, a determination is made if a presently broadcast, narrow cast 
or point cast stream includes an IEPG guide display including information 
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related to the next channel group. The method 1500 then proceeds to step 
1564. 

At step 1564 a query is made as to whether the next channel group is 
in fact available. If the query at step 1564 is answered affirmatively, then 

5 the method 1500 proceeds to step 1568. If the query at step 1564 is ■ 
answered negatively, then the method 1500 proceeds to step 1566. 

At step 1566 a request is made by the set top terminal to the head 
end for the head end to retrieve information associated with the next 
channel group (i.e., the guide and image portions of the IEPG display 

10 including the next channel group, or alternatively, a previously stored video 
screen including the appropriate information). As previously noted, by 
requesting such information at this point the apparent latency of the 
system, as experienced by the user, is greatly reduced. The method 1500 
then proceeds to step 1568. 

15 At step 1568 channel indicators 641A and 641B are decremented or 

moved down by one channel content object 610. The method 1500 then 
proceeds to step 1510, where it. waits for user input. 

FIG. 16 depicts a flow diagram of a head end stream request 
processing method. Specifically, FIG. 16 depicts a flow diagram of a method 

20 1600 for responding to a request for a point cast stream, simple for use in a 
head within the information distribution system of FIG. 4 or FIG. 17. 

The method 1600 is entered at step 1602 and proceeds, to step 1604, 
where a request for a pointcast or a narrow cast stream is received by the 
head end. The method 1600 then proceeds to step 1606, where a query is 

25 made to determine whether the requested stream is presently being 
provided to any user on the same QAM information stream or forward 
channel stream. If the query at step 1606 is answered negatively, then the 
method 1600 proceeds to step 1608. If the query at 1606 is answered 
affirmatively, then the method 1600 proceeds to step 1604. 

30 At step 1608 the requested stream is constructed or retrieved from a 

storage device. In the case of real-time, synchronized encoding of a plurality 
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of guide streams, the encoded, packetized stream is retrieved. The method 
then proceeds to step 1612. 

At step 1612, a PID is assigned to the retrieved or constructed stream 
and, additionally, a PID/Guide ID table associated with the QAM 
5 information stream is updated to indicated that the assigned PID is now 
associated with the requested stream. The method 1600 then proceeds to 
step 1614 where a point cast session is initiated in the manner described 
above with respect to FIGs. 2-5. The method 1600 then proceeds to step 
1616. 

10 It should be noted that the head end provides, for each QAM channel, 

a PID/Guide ID table stream that conveys to each STT the PID assignment 
for each stream being provided. In the case of the program guide streams, 
each program guide stream is represented in a relational way from the 
present-time broadcast guide streams. If user interaction indicates that a 

15 new guide stream is to be selected, the STT examines the PID/Guide ID to 
see which PID is associated with the Guide ID representing the new guide 
stream, if there is no PID entry in the table, then it is likely that a 
PointCast or narrowcast session is necessary to provide the new stream via a 
PID that is selected by the head end. 

20 Advantageously, the above described embodiments of the invention 

utilize a very small amount of STT memory (typically less than 100Kb). 
Additionally, the invention takes the consumer navigation experience from 
the confusing guide presentations of the prior art* back up to the level of a 
television experience-and adds interactivity. This is achieved by basing the 

25 user interaction model on a series of digitally-delivered, compressed video 
dips that include the appropriate guide information as integrated imagery 
along with, e.g., promotional video and audio information. In this manner, 
the local storage of guide data and the rasterization or compositing of the 
locally stored guide data at the set-top box is avoided. 

30 It must be noted that the above-described data structures and other 

methods provided for sending video streams to the set top terminals may be 
formed in accordance with the teachings of contemporaneously filed U.S. 
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Patent Application Number {attorney docket 

number DIVA 071), which is incorporated herein by reference in its entirety. 

Specifically, the '071 application provides a data structure suited to 
efficiently representing a plurality of image streams including common and 
5 non-common portions. Specifically, a plurality of similar group of picture 
(GOP) data structures representing the corresponding plurality of image 
streams including common and non-common portions is adapted to provide 
a first encoded stream comprising only P-picture and B-picture access units 
of one of the similar GOP data structures, and a corresponding plurality.of 

10 encoded streams comprising only respective I-picture access units of the 
s imil ar GOP data structures. In this manner, the redundant P-picture and 
B-picture access units within the encoded streams are eliminated, thereby 
greatly reducing the bandwidth or memory resources needed to transmit or 
store the plurality of image streams. 

15 A data structure according to the '071 invention comprises: a 

multiplexed stream comprising a plurality of video streams representing 
respective first portions of a group of pictures (GOP) information structure, 
each of the respective first portions including an access unit associated with 
an I-picture and a video stream representing a remaining portion of the 

20 GOP information structure including at least one of an access unit 

associated with a P-picture and an access unit associated with a B-picture, 
wherein: a concatenation of one of the respective first portions of the GOP 
information structure and the second portion of the GOP structure results in 
a complete GOP information structure. 

25 Although various embodiments which incorporate the teachings of 

the present invention have been shown and described in detail herein, those 
skilled in the art can readily devise many other varied embodiments that 
still incorporate these teachings. 



SUBSTITUTE SHEET (RULE 26) 



WO 00/64169 



PCT/US00/10O59 



-65- 

What is claimed is: 

1. A program guide, comprising: 

a video layer comprising a plurality of video objects including; title 
5 objects, eacb title object having associated with it a channel and at least one 
time slot, said video layer being formed in response to a received video 
stream; and 

. a graphics layer comprising a plurality of graphics objects including 
title overlay objects, each of said title overlay objects selectively imparting 
10 at least a visual de-emphasis to a respective title object in said video layer, 
said visual de-emphasis being imparted to title objects not being associated 
with a desired time slot. 

2. The method of claim 1, wherein an opacity level of said title overlay 
15 object is increased to impart said visual de-emphasis to a respective title 

object. 

3. The method of claim 1, wherein a color of said title overlay object is 
adapted to impart said visual de-emphasis to a respective title object. 

20 

4. The method of claim 2, wherein title objects subjected to de-emphasis 
are substantially hidden. 
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